OOM Error after 10 epochs in SSD Resnet-18

Hi,
Getting OOM error after 10th Epoch
1st tried using one 1660 Ti with 6GB GPU Memory. Batch size for gpu is 1
2nd I tried using two 1660 Ti with 12 GB GPU Memory.Batch size per gpu is 1 still getting OOM

Here is the log:

[code]Epoch 00010: saving model to /workspace/tlt-experiments/experiment_dir_unpruned/weights/ssd_resnet18_epoch_010.tlt
WARNING:tensorflow:From ./ssd/box_coder/output_decoder_layer.py:83: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use tf.cast instead.
2019-11-20 06:09:36,167 [WARNING] tensorflow: From ./ssd/box_coder/output_decoder_layer.py:83: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use tf.cast instead.
Number of images in the evaluation dataset: 417
()
Producing predictions batch-wise: 0% 0/14 [00:00<?, ?it/s]2019-11-20 06:09:53.415515: W tensorflow/core/common_runtime/bfc_allocator.cc:267] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.96GiB. Current allocation summary follows.
2019-11-20 06:09:53.415716: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (256): Total Chunks: 425, Chunks in use: 425. 106.2KiB allocated for chunks. 106.2KiB in use in bin. 55.3KiB client-requested in use in bin.
2019-11-20 06:09:53.415773: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (512): Total Chunks: 188, Chunks in use: 188. 95.0KiB allocated for chunks. 95.0KiB in use in bin. 94.8KiB client-requested in use in bin.
2019-11-20 06:09:53.415807: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (1024): Total Chunks: 189, Chunks in use: 189. 189.2KiB allocated for chunks. 189.2KiB in use in bin. 189.0KiB client-requested in use in bin.
2019-11-20 06:09:53.415836: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (2048): Total Chunks: 176, Chunks in use: 176. 352.0KiB allocated for chunks. 352.0KiB in use in bin. 352.0KiB client-requested in use in bin.
2019-11-20 06:09:53.415864: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (4096): Total Chunks: 11, Chunks in use: 11. 47.5KiB allocated for chunks. 47.5KiB in use in bin. 47.5KiB client-requested in use in bin.
2019-11-20 06:09:53.415891: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (8192): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin.
2019-11-20 06:09:53.415920: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (16384): Total Chunks: 16, Chunks in use: 16. 265.5KiB allocated for chunks. 265.5KiB in use in bin. 265.3KiB client-requested in use in bin.
2019-11-20 06:09:53.415949: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (32768): Total Chunks: 15, Chunks in use: 15. 508.5KiB allocated for chunks. 508.5KiB in use in bin. 508.5KiB client-requested in use in bin.
2019-11-20 06:09:53.415975: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (65536): Total Chunks: 22, Chunks in use: 22. 1.76MiB allocated for chunks. 1.76MiB in use in bin. 1.76MiB client-requested in use in bin.
2019-11-20 06:09:53.416003: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (131072): Total Chunks: 73, Chunks in use: 73. 11.16MiB allocated for chunks. 11.16MiB in use in bin. 11.13MiB client-requested in use in bin.
2019-11-20 06:09:53.416031: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (262144): Total Chunks: 47, Chunks in use: 47. 14.67MiB allocated for chunks. 14.67MiB in use in bin. 14.54MiB client-requested in use in bin.
2019-11-20 06:09:53.416059: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (524288): Total Chunks: 32, Chunks in use: 32. 17.40MiB allocated for chunks. 17.40MiB in use in bin. 17.05MiB client-requested in use in bin.
2019-11-20 06:09:53.416087: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (1048576): Total Chunks: 37, Chunks in use: 37. 40.12MiB allocated for chunks. 40.12MiB in use in bin. 40.12MiB client-requested in use in bin.
2019-11-20 06:09:53.416116: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (2097152): Total Chunks: 23, Chunks in use: 23. 55.90MiB allocated for chunks. 55.90MiB in use in bin. 55.90MiB client-requested in use in bin.
2019-11-20 06:09:53.416145: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (4194304): Total Chunks: 22, Chunks in use: 22. 102.44MiB allocated for chunks. 102.44MiB in use in bin. 98.61MiB client-requested in use in bin.
2019-11-20 06:09:53.416174: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (8388608): Total Chunks: 21, Chunks in use: 21. 190.00MiB allocated for chunks. 190.00MiB in use in bin. 189.00MiB client-requested in use in bin.
2019-11-20 06:09:53.416203: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (16777216): Total Chunks: 6, Chunks in use: 6. 109.23MiB allocated for chunks. 109.23MiB in use in bin. 104.86MiB client-requested in use in bin.
2019-11-20 06:09:53.416231: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (33554432): Total Chunks: 1, Chunks in use: 1. 32.00MiB allocated for chunks. 32.00MiB in use in bin. 18.00MiB client-requested in use in bin.
2019-11-20 06:09:53.416255: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (67108864): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin.
2019-11-20 06:09:53.416279: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (134217728): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin.
2019-11-20 06:09:53.416307: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (268435456): Total Chunks: 5, Chunks in use: 1. 4.22GiB allocated for chunks. 765.98MiB in use in bin. 765.98MiB client-requested in use in bin.
2019-11-20 06:09:53.416333: I tensorflow/core/common_runtime/bfc_allocator.cc:613] Bin for 3.96GiB was 256.00MiB, Chunk State:
2019-11-20 06:09:53.416369: I tensorflow/core/common_runtime/bfc_allocator.cc:619] Size: 264.58MiB | Requested Size: 2B | in_use: 0, prev: Size: 2.0KiB | Requested Size: 2.0KiB | in_use: 1
2019-11-20 06:09:53.416401: I tensorflow/core/common_runtime/bfc_allocator.cc:619] Size: 446.83MiB | Requested Size: 23.73MiB | in_use: 0, prev: Size: 256B | Requested Size: 24B | in_use: 1
2019-11-20 06:09:53.416432: I tensorflow/core/common_runtime/bfc_allocator.cc:619] Size: 759.38MiB | Requested Size: 759.38MiB | in_use: 0, next: Size: 2.0KiB | Requested Size: 2.0KiB | in_use: 1
2019-11-20 06:09:53.416462: I tensorflow/core/common_runtime/bfc_allocator.cc:619] Size: 2.04GiB | Requested Size: 32B | in_use: 0, prev: Size: 765.98MiB | Requested Size: 765.98MiB | in_use: 1
2019-11-20 06:09:53.416489: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f3138000000 of size 803188224
2019-11-20 06:09:53.416511: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Free at 0x7f3167dfae00 of size 2185272832
2019-11-20 06:09:53.416533: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Free at 0x7f31f0000000 of size 796262400
2019-11-20 06:09:53.416555: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f760000 of size 2048
2019-11-20 06:09:53.416576: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f760800 of size 2048
2019-11-20 06:09:53.416597: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f761000 of size 1024
2019-11-20 06:09:53.416618: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f761400 of size 1024
2019-11-20 06:09:53.416639: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f761800 of size 512
2019-11-20 06:09:53.416660: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f761a00 of size 512
2019-11-20 06:09:53.416681: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f761c00 of size 256
2019-11-20 06:09:53.416702: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f761d00 of size 256
2019-11-20 06:09:53.416723: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f761e00 of size 256
2019-11-20 06:09:53.416743: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f761f00 of size 256
2019-11-20 06:09:53.416763: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f762000 of size 256
2019-11-20 06:09:53.416784: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f762100 of size 256
2019-11-20 06:09:53.416804: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f762200 of size 256
2019-11-20 06:09:53.416825: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f762300 of size 512
2019-11-20 06:09:53.416845: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f762500 of size 512
2019-11-20 06:09:53.416867: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f762700 of size 512
2019-11-20 06:09:53.416887: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f762900 of size 512
2019-11-20 06:09:53.416908: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f762b00 of size 1024
2019-11-20 06:09:53.416928: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f762f00 of size 1024
2019-11-20 06:09:53.416949: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f763300 of size 1024
2019-11-20 06:09:53.416970: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f763700 of size 1024
2019-11-20 06:09:53.416991: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f763b00 of size 2048
2019-11-20 06:09:53.417012: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f764300 of size 2048
2019-11-20 06:09:53.417032: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f764b00 of size 2048
2019-11-20 06:09:53.417053: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f765300 of size 2048
2019-11-20 06:09:53.417074: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f765b00 of size 2048
2019-11-20 06:09:53.417094: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f766300 of size 2048
2019-11-20 06:09:53.417115: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f766b00 of size 1024
2019-11-20 06:09:53.417135: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f766f00 of size 1024
2019-11-20 06:09:53.417155: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f767300 of size 512
2019-11-20 06:09:53.417176: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f767500 of size 512
2019-11-20 06:09:53.417196: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f767700 of size 256
2019-11-20 06:09:53.417216: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f767800 of size 256
2019-11-20 06:09:53.417236: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f767900 of size 256
2019-11-20 06:09:53.417257: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f767a00 of size 256
2019-11-20 06:09:53.417277: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f767b00 of size 256
2019-11-20 06:09:53.417297: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f767c00 of size 256
2019-11-20 06:09:53.417317: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f767d00 of size 256
2019-11-20 06:09:53.417337: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f767e00 of size 512
2019-11-20 06:09:53.417358: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f768000 of size 512
2019-11-20 06:09:53.417378: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f768200 of size 512
2019-11-20 06:09:53.417398: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f768400 of size 512
2019-11-20 06:09:53.417419: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f768600 of size 1024
2019-11-20 06:09:53.417439: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f768a00 of size 1024
2019-11-20 06:09:53.417460: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f768e00 of size 1024
2019-11-20 06:09:53.417480: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f769200 of size 1024
2019-11-20 06:09:53.417501: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f769600 of size 2048
2019-11-20 06:09:53.417521: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f769e00 of size 2048
2019-11-20 06:09:53.417542: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f76a600 of size 2048
2019-11-20 06:09:53.417562: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f321f76ae00 of size 2048
2019-11-20 06:09:53.417583: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Free at 0x7f321f76b600 of size 277432832
2019-11-20 06:09:53.417605: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32ac000000 of size 4155392
2019-11-20 06:09:53.417625: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32ac3f6800 of size 256
2019-11-20 06:09:53.417646: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32ac3f6900 of size 256
2019-11-20 06:09:53.417668: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32ac3f6a00 of size 8310784
2019-11-20 06:09:53.417690: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32acbe3a00 of size 256
2019-11-20 06:09:53.417710: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32acbe3b00 of size 256
2019-11-20 06:09:53.417731: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32acbe3c00 of size 4155392
2019-11-20 06:09:53.417752: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32acfda400 of size 65536
2019-11-20 06:09:53.417774: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32acfea400 of size 589824
2019-11-20 06:09:53.417795: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32ad07a400 of size 32768
2019-11-20 06:09:53.417818: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32ad082400 of size 294912
2019-11-20 06:09:53.417841: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32ad0ca400 of size 147456
2019-11-20 06:09:53.417862: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32ad0ee400 of size 16384
2019-11-20 06:09:53.417884: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32ad0f2400 of size 221184
2019-11-20 06:09:53.417906: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32ad128400 of size 442368
2019-11-20 06:09:53.417927: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32ad194400 of size 110592
2019-11-20 06:09:53.417951: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32ad1af400 of size 165888
2019-11-20 06:09:53.417976: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32ad1d7c00 of size 331776
2019-11-20 06:09:53.418000: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32ad228c00 of size 82944
2019-11-20 06:09:53.418023: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32ad23d000 of size 1179648
2019-11-20 06:09:53.418047: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32ad35d000 of size 131072
2019-11-20 06:09:53.418070: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32ad37d000 of size 262144
2019-11-20 06:09:53.418093: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32ad3bd000 of size 4718592
2019-11-20 06:09:53.418116: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32ad83d000 of size 1048576
2019-11-20 06:09:53.418138: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32ad93d000 of size 4194304
2019-11-20 06:09:53.418161: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32add3d000 of size 18874368
2019-11-20 06:09:53.418184: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32aef3d000 of size 1048576
2019-11-20 06:09:53.418206: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32af03d000 of size 9437184
2019-11-20 06:09:53.418229: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32af93d000 of size 256
2019-11-20 06:09:53.418252: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32af93d100 of size 256
2019-11-20 06:09:53.418274: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32af93d200 of size 256
2019-11-20 06:09:53.418296: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32af93d300 of size 256
2019-11-20 06:09:53.418318: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32af93d400 of size 256
2019-11-20 06:09:53.418340: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32af93d500 of size 256
2019-11-20 06:09:53.418363: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32af93d600 of size 256
2019-11-20 06:09:53.418384: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32af93d700 of size 256
2019-11-20 06:09:53.418406: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32af93d800 of size 256
2019-11-20 06:09:53.418429: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32af93d900 of size 256
2019-11-20 06:09:53.418451: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32af93da00 of size 256
2019-11-20 06:09:53.418474: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32af93db00 of size 256
2019-11-20 06:09:53.418496: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32af93dc00 of size 256
2019-11-20 06:09:53.418519: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32af93dd00 of size 256
2019-11-20 06:09:53.418541: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32af93de00 of size 256
2019-11-20 06:09:53.418563: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32af93df00 of size 256
2019-11-20 06:09:53.418585: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32af93e000 of size 256
2019-11-20 06:09:53.418607: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32af93e100 of size 256
2019-11-20 06:09:53.418629: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32af93e200 of size 256
2019-11-20 06:09:53.418651: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32af93e300 of size 256
2019-11-20 06:09:53.418674: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32af93e400 of size 256
2019-11-20 06:09:53.418696: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32af93e500 of size 256
2019-11-20 06:09:53.418717: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32af93e600 of size 256
2019-11-20 06:09:53.418739: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32af93e700 of size 256
2019-11-20 06:09:53.418761: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32af93e800 of size 256
2019-11-20 06:09:53.418783: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32af93e900 of size 256
2019-11-20 06:09:53.418806: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32af93ea00 of size 7680
2019-11-20 06:09:53.418829: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32af940800 of size 26112
2019-11-20 06:09:53.418852: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32af946e00 of size 98048
2019-11-20 06:09:53.418875: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32af95ed00 of size 391680
2019-11-20 06:09:53.418897: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32af9be700 of size 1566720
2019-11-20 06:09:53.418920: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32afb3cf00 of size 6220800
2019-11-20 06:09:53.418942: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32b012bb00 of size 256
2019-11-20 06:09:53.418965: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32b012bc00 of size 256
2019-11-20 06:09:53.418987: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32b012bd00 of size 256
2019-11-20 06:09:53.419009: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32b012be00 of size 256
2019-11-20 06:09:53.419031: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32b012bf00 of size 256
2019-11-20 06:09:53.419053: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32b012c000 of size 256
2019-11-20 06:09:53.419075: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Free at 0x7f32b012c100 of size 468532992
2019-11-20 06:09:53.419098: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f2000000 of size 2359296
2019-11-20 06:09:53.419121: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f2240000 of size 2359296
2019-11-20 06:09:53.419142: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f2480000 of size 2359296
2019-11-20 06:09:53.419165: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f26c0000 of size 2359296
2019-11-20 06:09:53.419187: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f2900000 of size 2359296
2019-11-20 06:09:53.419210: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f2b40000 of size 2359296
2019-11-20 06:09:53.419232: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f2d80000 of size 1024
2019-11-20 06:09:53.419252: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f2d80400 of size 1024
2019-11-20 06:09:53.419273: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f2d80800 of size 1024
2019-11-20 06:09:53.419293: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f2d80c00 of size 1024
2019-11-20 06:09:53.419314: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f2d81000 of size 1024
2019-11-20 06:09:53.419335: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f2d81400 of size 1024
2019-11-20 06:09:53.419356: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f2d81800 of size 1024
2019-11-20 06:09:53.419376: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f2d81c00 of size 1024
2019-11-20 06:09:53.419396: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f2d82000 of size 1179648
2019-11-20 06:09:53.419418: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f2ea2000 of size 1179648
2019-11-20 06:09:53.419438: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f2fc2000 of size 1179648
2019-11-20 06:09:53.419459: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f30e2000 of size 1179648
2019-11-20 06:09:53.419479: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3202000 of size 1179648
2019-11-20 06:09:53.419499: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3322000 of size 1179648
2019-11-20 06:09:53.419519: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3442000 of size 1179648
2019-11-20 06:09:53.419540: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3562000 of size 1179648
2019-11-20 06:09:53.419560: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3682000 of size 1179648
2019-11-20 06:09:53.419580: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f37a2000 of size 1179648
2019-11-20 06:09:53.419601: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f38c2000 of size 1179648
2019-11-20 06:09:53.419621: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f39e2000 of size 1179648
2019-11-20 06:09:53.419660: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3b02000 of size 1179648
2019-11-20 06:09:53.419681: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c22000 of size 1024
2019-11-20 06:09:53.419702: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c22400 of size 1024
2019-11-20 06:09:53.419723: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c22800 of size 1024
2019-11-20 06:09:53.419743: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c22c00 of size 1024
2019-11-20 06:09:53.419764: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c23000 of size 1024
2019-11-20 06:09:53.419785: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c23400 of size 1024
2019-11-20 06:09:53.419805: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c23800 of size 1024
2019-11-20 06:09:53.419826: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c23c00 of size 1024
2019-11-20 06:09:53.419846: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c24000 of size 1024
2019-11-20 06:09:53.419867: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c24400 of size 1024
2019-11-20 06:09:53.419887: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c24800 of size 1024
2019-11-20 06:09:53.419909: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c24c00 of size 1024
2019-11-20 06:09:53.419929: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c25000 of size 1024
2019-11-20 06:09:53.419950: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c25400 of size 1024
2019-11-20 06:09:53.419970: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c25800 of size 1024
2019-11-20 06:09:53.419990: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c25c00 of size 1024
2019-11-20 06:09:53.420012: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c26000 of size 1024
2019-11-20 06:09:53.420032: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c26400 of size 1024
2019-11-20 06:09:53.420052: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c26800 of size 1024
2019-11-20 06:09:53.420072: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c26c00 of size 1024
2019-11-20 06:09:53.420093: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c27000 of size 1024
2019-11-20 06:09:53.420113: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c27400 of size 1024
2019-11-20 06:09:53.420134: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c27800 of size 1024
2019-11-20 06:09:53.420154: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c27c00 of size 1024
2019-11-20 06:09:53.420175: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c28000 of size 1024
2019-11-20 06:09:53.420196: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c28400 of size 1024
2019-11-20 06:09:53.420217: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c28800 of size 1024
2019-11-20 06:09:53.420237: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c28c00 of size 1024
2019-11-20 06:09:53.420257: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c29000 of size 1024
2019-11-20 06:09:53.420278: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c29400 of size 1024
2019-11-20 06:09:53.420299: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c29800 of size 1024
2019-11-20 06:09:53.420319: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c29c00 of size 1024
2019-11-20 06:09:53.420340: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c2a000 of size 1024
2019-11-20 06:09:53.420361: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c2a400 of size 1024
2019-11-20 06:09:53.420381: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c2a800 of size 1024
2019-11-20 06:09:53.420401: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c2ac00 of size 1024
2019-11-20 06:09:53.420422: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c2b000 of size 1024
2019-11-20 06:09:53.420443: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c2b400 of size 1024
2019-11-20 06:09:53.420463: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c2b800 of size 1024
2019-11-20 06:09:53.420484: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c2bc00 of size 1024
2019-11-20 06:09:53.420504: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c2c000 of size 1024
2019-11-20 06:09:53.420524: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c2c400 of size 1024
2019-11-20 06:09:53.420545: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c2c800 of size 1024
2019-11-20 06:09:53.420565: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c2cc00 of size 1024
2019-11-20 06:09:53.420585: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c2d000 of size 1024
2019-11-20 06:09:53.420606: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c2d400 of size 1024
2019-11-20 06:09:53.420626: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c2d800 of size 1024
2019-11-20 06:09:53.420647: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c2dc00 of size 1024
2019-11-20 06:09:53.420668: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c2e000 of size 1024
2019-11-20 06:09:53.420689: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c2e400 of size 1024
2019-11-20 06:09:53.420710: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c2e800 of size 1024
2019-11-20 06:09:53.420730: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c2ec00 of size 1024
2019-11-20 06:09:53.420751: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c2f000 of size 65536
2019-11-20 06:09:53.420772: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c3f000 of size 65536
2019-11-20 06:09:53.420792: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c4f000 of size 65536
2019-11-20 06:09:53.420813: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c5f000 of size 65536
2019-11-20 06:09:53.420833: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c6f000 of size 512
2019-11-20 06:09:53.420854: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c6f200 of size 512
2019-11-20 06:09:53.420875: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c6f400 of size 512
2019-11-20 06:09:53.420896: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c6f600 of size 512
2019-11-20 06:09:53.420916: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3c6f800 of size 589824
2019-11-20 06:09:53.420937: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3cff800 of size 589824
2019-11-20 06:09:53.420958: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3d8f800 of size 589824
2019-11-20 06:09:53.420978: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3e1f800 of size 589824
2019-11-20 06:09:53.420998: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3eaf800 of size 589824
2019-11-20 06:09:53.421019: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3f3f800 of size 589824
2019-11-20 06:09:53.421045: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f3fcf800 of size 589824
2019-11-20 06:09:53.421066: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f405f800 of size 589824
2019-11-20 06:09:53.421087: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f40ef800 of size 589824
2019-11-20 06:09:53.421107: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f417f800 of size 589824
2019-11-20 06:09:53.421127: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f420f800 of size 589824
2019-11-20 06:09:53.421147: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f429f800 of size 589824
2019-11-20 06:09:53.421168: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f432f800 of size 512
2019-11-20 06:09:53.421188: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f432fa00 of size 512
2019-11-20 06:09:53.421209: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f432fc00 of size 512
2019-11-20 06:09:53.421230: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f432fe00 of size 512
2019-11-20 06:09:53.421250: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4330000 of size 512
2019-11-20 06:09:53.421270: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4330200 of size 512
2019-11-20 06:09:53.421291: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4330400 of size 512
2019-11-20 06:09:53.421311: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4330600 of size 512
2019-11-20 06:09:53.421331: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4330800 of size 512
2019-11-20 06:09:53.421352: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4330a00 of size 512
2019-11-20 06:09:53.421372: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4330c00 of size 512
2019-11-20 06:09:53.421393: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4330e00 of size 512
2019-11-20 06:09:53.421413: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4331000 of size 512
2019-11-20 06:09:53.421434: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4331200 of size 512
2019-11-20 06:09:53.421454: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4331400 of size 512
2019-11-20 06:09:53.421475: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4331600 of size 512
2019-11-20 06:09:53.421495: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4331800 of size 512
2019-11-20 06:09:53.421516: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4331a00 of size 512
2019-11-20 06:09:53.421536: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4331c00 of size 512
2019-11-20 06:09:53.421556: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4331e00 of size 512
2019-11-20 06:09:53.421576: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4332000 of size 512
2019-11-20 06:09:53.421596: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4332200 of size 512
2019-11-20 06:09:53.421616: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4332400 of size 512
2019-11-20 06:09:53.421637: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4332600 of size 512
2019-11-20 06:09:53.421657: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4332800 of size 512
2019-11-20 06:09:53.421677: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4332a00 of size 512
2019-11-20 06:09:53.421697: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4332c00 of size 512
2019-11-20 06:09:53.421718: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4332e00 of size 512
2019-11-20 06:09:53.421739: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4333000 of size 512
2019-11-20 06:09:53.421760: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4333200 of size 512
2019-11-20 06:09:53.421781: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4333400 of size 512
2019-11-20 06:09:53.421801: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4333600 of size 512
2019-11-20 06:09:53.421821: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4333800 of size 512
2019-11-20 06:09:53.421841: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4333a00 of size 512
2019-11-20 06:09:53.421862: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4333c00 of size 512
2019-11-20 06:09:53.421882: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4333e00 of size 512
2019-11-20 06:09:53.421902: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4334000 of size 512
2019-11-20 06:09:53.421923: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4334200 of size 512
2019-11-20 06:09:53.421944: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4334400 of size 512
2019-11-20 06:09:53.421964: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4334600 of size 512
2019-11-20 06:09:53.421984: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4334800 of size 512
2019-11-20 06:09:53.422005: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4334a00 of size 512
2019-11-20 06:09:53.422026: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4334c00 of size 512
2019-11-20 06:09:53.422047: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4334e00 of size 512
2019-11-20 06:09:53.422067: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4335000 of size 512
2019-11-20 06:09:53.422087: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4335200 of size 512
2019-11-20 06:09:53.422107: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4335400 of size 512
2019-11-20 06:09:53.422127: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4335600 of size 512
2019-11-20 06:09:53.422147: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4335800 of size 512
2019-11-20 06:09:53.422168: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4335a00 of size 512
2019-11-20 06:09:53.422188: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4335c00 of size 512
2019-11-20 06:09:53.422208: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4335e00 of size 512
2019-11-20 06:09:53.422228: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4336000 of size 512
2019-11-20 06:09:53.422248: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4336200 of size 512
2019-11-20 06:09:53.422269: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4336400 of size 512
2019-11-20 06:09:53.422290: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4336600 of size 512
2019-11-20 06:09:53.422310: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4336800 of size 32768
2019-11-20 06:09:53.422331: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f433e800 of size 32768
2019-11-20 06:09:53.422352: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4346800 of size 32768
2019-11-20 06:09:53.422372: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f434e800 of size 32768
2019-11-20 06:09:53.422392: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4356800 of size 512
2019-11-20 06:09:53.422413: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4356a00 of size 512
2019-11-20 06:09:53.422435: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4356c00 of size 512
2019-11-20 06:09:53.422456: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4356e00 of size 512
2019-11-20 06:09:53.422476: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4357000 of size 512
2019-11-20 06:09:53.422497: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4357200 of size 512
2019-11-20 06:09:53.422517: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4357400 of size 512
2019-11-20 06:09:53.422539: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4357600 of size 512
2019-11-20 06:09:53.422560: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4357800 of size 294912
2019-11-20 06:09:53.422580: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f439f800 of size 294912
2019-11-20 06:09:53.422601: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f43e7800 of size 294912
2019-11-20 06:09:53.422621: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f442f800 of size 294912
2019-11-20 06:09:53.422642: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4477800 of size 512
2019-11-20 06:09:53.422662: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4477a00 of size 512
2019-11-20 06:09:53.422682: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4477c00 of size 512
2019-11-20 06:09:53.422703: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4477e00 of size 512
2019-11-20 06:09:53.422723: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4478000 of size 512
2019-11-20 06:09:53.422743: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4478200 of size 512
2019-11-20 06:09:53.422764: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4478400 of size 512
2019-11-20 06:09:53.422784: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4478600 of size 512
2019-11-20 06:09:53.422804: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4478800 of size 512
2019-11-20 06:09:53.422824: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4478a00 of size 512
2019-11-20 06:09:53.422845: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4478c00 of size 512
2019-11-20 06:09:53.422865: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4478e00 of size 512
2019-11-20 06:09:53.422886: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4479000 of size 512
2019-11-20 06:09:53.422906: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4479200 of size 512
2019-11-20 06:09:53.422926: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4479400 of size 512
2019-11-20 06:09:53.422946: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4479600 of size 512
2019-11-20 06:09:53.422966: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4479800 of size 512
2019-11-20 06:09:53.422986: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4479a00 of size 512
2019-11-20 06:09:53.423007: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4479c00 of size 512
2019-11-20 06:09:53.423027: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4479e00 of size 512
2019-11-20 06:09:53.423047: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f447a000 of size 512
2019-11-20 06:09:53.423067: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f447a200 of size 512
2019-11-20 06:09:53.423087: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f447a400 of size 512
2019-11-20 06:09:53.423107: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f447a600 of size 512
2019-11-20 06:09:53.423129: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f447a800 of size 512
2019-11-20 06:09:53.423150: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f447aa00 of size 512
2019-11-20 06:09:53.423170: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f447ac00 of size 512
2019-11-20 06:09:53.423190: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f447ae00 of size 512
2019-11-20 06:09:53.423210: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f447b000 of size 512
2019-11-20 06:09:53.423230: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f447b200 of size 512
2019-11-20 06:09:53.423250: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f447b400 of size 512
2019-11-20 06:09:53.423270: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f447b600 of size 512
2019-11-20 06:09:53.423290: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f447b800 of size 512
2019-11-20 06:09:53.423311: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f447ba00 of size 512
2019-11-20 06:09:53.423331: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f447bc00 of size 512
2019-11-20 06:09:53.423351: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f447be00 of size 512
2019-11-20 06:09:53.423371: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f447c000 of size 512
2019-11-20 06:09:53.423392: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f447c200 of size 512
2019-11-20 06:09:53.423413: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f447c400 of size 512
2019-11-20 06:09:53.423433: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f447c600 of size 512
2019-11-20 06:09:53.423453: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f447c800 of size 512
2019-11-20 06:09:53.423474: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f447ca00 of size 512
2019-11-20 06:09:53.423494: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f447cc00 of size 512
2019-11-20 06:09:53.423514: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f447ce00 of size 512
2019-11-20 06:09:53.423535: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f447d000 of size 512
2019-11-20 06:09:53.423555: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f447d200 of size 512
2019-11-20 06:09:53.423575: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f447d400 of size 512
2019-11-20 06:09:53.423595: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f447d600 of size 512
2019-11-20 06:09:53.423615: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f447d800 of size 512
2019-11-20 06:09:53.423647: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f447da00 of size 512
2019-11-20 06:09:53.423669: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f447dc00 of size 512
2019-11-20 06:09:53.423690: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f447de00 of size 512
2019-11-20 06:09:53.423711: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f447e000 of size 16384
2019-11-20 06:09:53.423732: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4482000 of size 16384
2019-11-20 06:09:53.423752: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4486000 of size 16384
2019-11-20 06:09:53.423773: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f448a000 of size 16384
2019-11-20 06:09:53.423794: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f448e000 of size 16384
2019-11-20 06:09:53.423814: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4492000 of size 16384
2019-11-20 06:09:53.423836: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4496000 of size 16384
2019-11-20 06:09:53.423857: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f449a000 of size 16384
2019-11-20 06:09:53.423877: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f449e000 of size 256
2019-11-20 06:09:53.423898: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f449e100 of size 256
2019-11-20 06:09:53.423918: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f449e200 of size 256
2019-11-20 06:09:53.423938: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f449e300 of size 256
2019-11-20 06:09:53.423959: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f449e400 of size 147456
2019-11-20 06:09:53.423980: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f44c2400 of size 147456
2019-11-20 06:09:53.424001: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f44e6400 of size 147456
2019-11-20 06:09:53.424021: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f450a400 of size 147456
2019-11-20 06:09:53.424041: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f452e400 of size 147456
2019-11-20 06:09:53.424061: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4552400 of size 147456
2019-11-20 06:09:53.424082: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4576400 of size 147456
2019-11-20 06:09:53.424102: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f459a400 of size 147456
2019-11-20 06:09:53.424122: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f45be400 of size 147456
2019-11-20 06:09:53.424142: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f45e2400 of size 147456
2019-11-20 06:09:53.424163: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4606400 of size 147456
2019-11-20 06:09:53.424183: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f462a400 of size 147456
2019-11-20 06:09:53.424203: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f464e400 of size 147456
2019-11-20 06:09:53.424223: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4672400 of size 147456
2019-11-20 06:09:53.424243: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f4696400 of size 147456
2019-11-20 06:09:53.424263: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46ba400 of size 147456
2019-11-20 06:09:53.424284: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46de400 of size 256
2019-11-20 06:09:53.424304: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46de500 of size 256
2019-11-20 06:09:53.424325: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46de600 of size 256
2019-11-20 06:09:53.424345: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46de700 of size 256
2019-11-20 06:09:53.424366: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46de800 of size 256
2019-11-20 06:09:53.424386: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46de900 of size 256
2019-11-20 06:09:53.424407: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46dea00 of size 256
2019-11-20 06:09:53.424427: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46deb00 of size 256
2019-11-20 06:09:53.424447: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46dec00 of size 256
2019-11-20 06:09:53.424467: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46ded00 of size 256
2019-11-20 06:09:53.424487: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46dee00 of size 256
2019-11-20 06:09:53.424509: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46def00 of size 256
2019-11-20 06:09:53.424530: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46df000 of size 256
2019-11-20 06:09:53.424550: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46df100 of size 256
2019-11-20 06:09:53.424571: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46df200 of size 256
2019-11-20 06:09:53.424591: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46df300 of size 256
2019-11-20 06:09:53.424611: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46df400 of size 256
2019-11-20 06:09:53.424631: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46df500 of size 256
2019-11-20 06:09:53.424652: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46df600 of size 256
2019-11-20 06:09:53.424672: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46df700 of size 256
2019-11-20 06:09:53.424692: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46df800 of size 256
2019-11-20 06:09:53.424712: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46df900 of size 256
2019-11-20 06:09:53.424732: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46dfa00 of size 256
2019-11-20 06:09:53.424752: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46dfb00 of size 256
2019-11-20 06:09:53.424772: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46dfc00 of size 256
2019-11-20 06:09:53.424793: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46dfd00 of size 256
2019-11-20 06:09:53.424813: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46dfe00 of size 256
2019-11-20 06:09:53.424833: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46dff00 of size 256
2019-11-20 06:09:53.424854: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e0000 of size 256
2019-11-20 06:09:53.424874: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e0100 of size 256
2019-11-20 06:09:53.424894: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e0200 of size 256
2019-11-20 06:09:53.424915: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e0300 of size 256
2019-11-20 06:09:53.424935: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e0400 of size 256
2019-11-20 06:09:53.424955: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e0500 of size 256
2019-11-20 06:09:53.424976: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e0600 of size 256
2019-11-20 06:09:53.424996: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e0700 of size 256
2019-11-20 06:09:53.425016: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e0800 of size 256
2019-11-20 06:09:53.425036: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e0900 of size 256
2019-11-20 06:09:53.425056: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e0a00 of size 256
2019-11-20 06:09:53.425077: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e0b00 of size 256
2019-11-20 06:09:53.425098: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e0c00 of size 256
2019-11-20 06:09:53.425119: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e0d00 of size 256
2019-11-20 06:09:53.425141: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e0e00 of size 256
2019-11-20 06:09:53.425161: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e0f00 of size 256
2019-11-20 06:09:53.425182: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e1000 of size 256
2019-11-20 06:09:53.425203: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e1100 of size 256
2019-11-20 06:09:53.425224: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e1200 of size 256
2019-11-20 06:09:53.425244: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e1300 of size 256
2019-11-20 06:09:53.425265: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e1400 of size 256
2019-11-20 06:09:53.425285: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e1500 of size 256
2019-11-20 06:09:53.425306: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e1600 of size 256
2019-11-20 06:09:53.425326: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e1700 of size 256
2019-11-20 06:09:53.425347: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e1800 of size 256
2019-11-20 06:09:53.425368: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e1900 of size 256
2019-11-20 06:09:53.425388: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e1a00 of size 256
2019-11-20 06:09:53.425409: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e1b00 of size 256
2019-11-20 06:09:53.425429: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e1c00 of size 256
2019-11-20 06:09:53.425450: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e1d00 of size 256
2019-11-20 06:09:53.425470: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e1e00 of size 256
2019-11-20 06:09:53.425496: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e1f00 of size 256
2019-11-20 06:09:53.425516: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e2000 of size 256
2019-11-20 06:09:53.425537: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e2100 of size 256
2019-11-20 06:09:53.425557: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e2200 of size 256
2019-11-20 06:09:53.425578: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e2300 of size 256
2019-11-20 06:09:53.425598: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e2400 of size 256
2019-11-20 06:09:53.425619: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e2500 of size 256
2019-11-20 06:09:53.425639: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e2600 of size 256
2019-11-20 06:09:53.425660: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e2700 of size 256
2019-11-20 06:09:53.425680: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e2800 of size 256
2019-11-20 06:09:53.425701: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e2900 of size 256
2019-11-20 06:09:53.425721: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e2a00 of size 256
2019-11-20 06:09:53.425743: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e2b00 of size 256
2019-11-20 06:09:53.425765: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e2c00 of size 256
2019-11-20 06:09:53.425785: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e2d00 of size 256
2019-11-20 06:09:53.425806: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e2e00 of size 256
2019-11-20 06:09:53.425826: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e2f00 of size 256
2019-11-20 06:09:53.425847: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e3000 of size 256
2019-11-20 06:09:53.425867: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e3100 of size 256
2019-11-20 06:09:53.425887: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e3200 of size 256
2019-11-20 06:09:53.425908: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e3300 of size 256
2019-11-20 06:09:53.425929: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e3400 of size 256
2019-11-20 06:09:53.425951: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e3500 of size 256
2019-11-20 06:09:53.425972: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e3600 of size 256
2019-11-20 06:09:53.426003: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e3700 of size 256
2019-11-20 06:09:53.426024: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e3800 of size 256
2019-11-20 06:09:53.426045: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e3900 of size 256
2019-11-20 06:09:53.426065: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e3a00 of size 256
2019-11-20 06:09:53.426085: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e3b00 of size 256
2019-11-20 06:09:53.426106: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e3c00 of size 256
2019-11-20 06:09:53.426127: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e3d00 of size 256
2019-11-20 06:09:53.426147: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e3e00 of size 256
2019-11-20 06:09:53.426169: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e3f00 of size 256
2019-11-20 06:09:53.426199: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e4000 of size 256
2019-11-20 06:09:53.426221: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e4100 of size 256
2019-11-20 06:09:53.426241: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e4200 of size 256
2019-11-20 06:09:53.426263: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e4300 of size 256
2019-11-20 06:09:53.426284: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e4400 of size 256
2019-11-20 06:09:53.426304: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e4500 of size 256
2019-11-20 06:09:53.426325: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e4600 of size 256
2019-11-20 06:09:53.426354: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e4700 of size 256
2019-11-20 06:09:53.426376: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e4800 of size 256
2019-11-20 06:09:53.426396: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e4900 of size 256
2019-11-20 06:09:53.426417: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e4a00 of size 256
2019-11-20 06:09:53.426437: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e4b00 of size 256
2019-11-20 06:09:53.426458: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e4c00 of size 256
2019-11-20 06:09:53.426478: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e4d00 of size 256
2019-11-20 06:09:53.426499: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e4e00 of size 256
2019-11-20 06:09:53.426520: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e4f00 of size 256
2019-11-20 06:09:53.426541: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e5000 of size 256
2019-11-20 06:09:53.426561: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e5100 of size 256
2019-11-20 06:09:53.426581: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e5200 of size 256
2019-11-20 06:09:53.426601: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e5300 of size 256
2019-11-20 06:09:53.426621: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7f32f46e5400 of size 256
2019-11-20 06:09:53.426641: I tensorflow/core/common_runtim

Hi psgr,
You log is not full.Please export below parameter to true and try again.
$ export TF_FORCE_GPU_ALLOW_GROWTH=true

Refer to https://devtalk.nvidia.com/default/topic/1066112/transfer-learning-toolkit/unable-to-train-ssd-resnet-18-/
and https://devtalk.nvidia.com/default/topic/1066050/transfer-learning-toolkit/error-with-cudnn-when-attempting-to-perform-inference-after-training-an-ssd-model-with-tlt/

[code]
Epoch 00009: saving model to /workspace/tlt-experiments/experiment_dir_unpruned/weights/ssd_resnet18_epoch_009.tlt
Epoch 10/180
1283/1283 [==============================] - 404s 315ms/step - loss: 0.0031

Epoch 00010: saving model to /workspace/tlt-experiments/experiment_dir_unpruned/weights/ssd_resnet18_epoch_010.tlt
WARNING:tensorflow:From ./ssd/box_coder/output_decoder_layer.py:83: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use tf.cast instead.
2019-11-20 08:22:58,086 [WARNING] tensorflow: From ./ssd/box_coder/output_decoder_layer.py:83: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use tf.cast instead.
Number of images in the evaluation dataset: 417
()
Producing predictions batch-wise: 0% 0/14 [00:00<?, ?it/s]2019-11-20 08:23:15.292786: W tensorflow/core/common_runtime/bfc_allocator.cc:267] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.96GiB. Current allocation summary follows.
2019-11-20 08:23:15.292838: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (256): Total Chunks: 425, Chunks in use: 425. 106.2KiB allocated for chunks. 106.2KiB in use in bin. 55.3KiB client-requested in use in bin.
2019-11-20 08:23:15.292846: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (512): Total Chunks: 188, Chunks in use: 188. 95.0KiB allocated for chunks. 95.0KiB in use in bin. 94.8KiB client-requested in use in bin.
2019-11-20 08:23:15.292853: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (1024): Total Chunks: 189, Chunks in use: 189. 189.2KiB allocated for chunks. 189.2KiB in use in bin. 189.0KiB client-requested in use in bin.
2019-11-20 08:23:15.292858: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (2048): Total Chunks: 176, Chunks in use: 176. 352.0KiB allocated for chunks. 352.0KiB in use in bin. 352.0KiB client-requested in use in bin.
2019-11-20 08:23:15.292864: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (4096): Total Chunks: 11, Chunks in use: 11. 47.5KiB allocated for chunks. 47.5KiB in use in bin. 47.5KiB client-requested in use in bin.
2019-11-20 08:23:15.292869: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (8192): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin.
2019-11-20 08:23:15.292875: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (16384): Total Chunks: 16, Chunks in use: 16. 265.5KiB allocated for chunks. 265.5KiB in use in bin. 265.3KiB client-requested in use in bin.
2019-11-20 08:23:15.292881: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (32768): Total Chunks: 15, Chunks in use: 15. 508.5KiB allocated for chunks. 508.5KiB in use in bin. 508.5KiB client-requested in use in bin.
2019-11-20 08:23:15.292886: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (65536): Total Chunks: 22, Chunks in use: 22. 1.76MiB allocated for chunks. 1.76MiB in use in bin. 1.76MiB client-requested in use in bin.
2019-11-20 08:23:15.292892: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (131072): Total Chunks: 73, Chunks in use: 73. 11.16MiB allocated for chunks. 11.16MiB in use in bin. 11.13MiB client-requested in use in bin.
2019-11-20 08:23:15.292898: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (262144): Total Chunks: 47, Chunks in use: 47. 14.67MiB allocated for chunks. 14.67MiB in use in bin. 14.54MiB client-requested in use in bin.
2019-11-20 08:23:15.292921: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (524288): Total Chunks: 32, Chunks in use: 32. 17.40MiB allocated for chunks. 17.40MiB in use in bin. 17.05MiB client-requested in use in bin.
2019-11-20 08:23:15.292927: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (1048576): Total Chunks: 37, Chunks in use: 37. 40.12MiB allocated for chunks. 40.12MiB in use in bin. 40.12MiB client-requested in use in bin.
2019-11-20 08:23:15.292933: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (2097152): Total Chunks: 23, Chunks in use: 23. 55.90MiB allocated for chunks. 55.90MiB in use in bin. 55.90MiB client-requested in use in bin.
2019-11-20 08:23:15.292939: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (4194304): Total Chunks: 22, Chunks in use: 22. 102.44MiB allocated for chunks. 102.44MiB in use in bin. 98.61MiB client-requested in use in bin.
2019-11-20 08:23:15.292944: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (8388608): Total Chunks: 21, Chunks in use: 21. 190.00MiB allocated for chunks. 190.00MiB in use in bin. 189.00MiB client-requested in use in bin.
2019-11-20 08:23:15.292950: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (16777216): Total Chunks: 6, Chunks in use: 6. 109.23MiB allocated for chunks. 109.23MiB in use in bin. 104.86MiB client-requested in use in bin.
2019-11-20 08:23:15.292956: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (33554432): Total Chunks: 1, Chunks in use: 1. 32.00MiB allocated for chunks. 32.00MiB in use in bin. 18.00MiB client-requested in use in bin.
2019-11-20 08:23:15.292961: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (67108864): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin.
2019-11-20 08:23:15.292966: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (134217728): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin.
2019-11-20 08:23:15.292972: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (268435456): Total Chunks: 5, Chunks in use: 1. 4.19GiB allocated for chunks. 765.98MiB in use in bin. 765.98MiB client-requested in use in bin.
2019-11-20 08:23:15.292977: I tensorflow/core/common_runtime/bfc_allocator.cc:613] Bin for 3.96GiB was 256.00MiB, Chunk State:
2019-11-20 08:23:15.292985: I tensorflow/core/common_runtime/bfc_allocator.cc:619] Size: 264.58MiB | Requested Size: 16B | in_use: 0, prev: Size: 2.0KiB | Requested Size: 2.0KiB | in_use: 1
2019-11-20 08:23:15.292991: I tensorflow/core/common_runtime/bfc_allocator.cc:619] Size: 446.83MiB | Requested Size: 23.73MiB | in_use: 0, prev: Size: 256B | Requested Size: 24B | in_use: 1
2019-11-20 08:23:15.292998: I tensorflow/core/common_runtime/bfc_allocator.cc:619] Size: 759.38MiB | Requested Size: 759.38MiB | in_use: 0, next: Size: 2.0KiB | Requested Size: 2.0KiB | in_use: 1
2019-11-20 08:23:15.293004: I tensorflow/core/common_runtime/bfc_allocator.cc:619] Size: 2.01GiB | Requested Size: 23.73MiB | in_use: 0, prev: Size: 765.98MiB | Requested Size: 765.98MiB | in_use: 1
2019-11-20 08:23:15.293010: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd4e6000000 of size 803188224
2019-11-20 08:23:15.293015: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Free at 0x7fd515dfae00 of size 2158082048
2019-11-20 08:23:15.293019: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Free at 0x7fd598000000 of size 796262400
2019-11-20 08:23:15.293024: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7760000 of size 2048
2019-11-20 08:23:15.293028: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7760800 of size 2048
2019-11-20 08:23:15.293032: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7761000 of size 1024
2019-11-20 08:23:15.293036: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7761400 of size 1024
2019-11-20 08:23:15.293041: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7761800 of size 512
2019-11-20 08:23:15.293045: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7761a00 of size 512
2019-11-20 08:23:15.293049: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7761c00 of size 256
2019-11-20 08:23:15.293053: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7761d00 of size 256
2019-11-20 08:23:15.293058: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7761e00 of size 256
2019-11-20 08:23:15.293062: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7761f00 of size 256
2019-11-20 08:23:15.293066: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7762000 of size 256
2019-11-20 08:23:15.293070: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7762100 of size 256
2019-11-20 08:23:15.293074: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7762200 of size 256
2019-11-20 08:23:15.293078: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7762300 of size 512
2019-11-20 08:23:15.293083: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7762500 of size 512
2019-11-20 08:23:15.293087: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7762700 of size 512
2019-11-20 08:23:15.293091: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7762900 of size 512
2019-11-20 08:23:15.293095: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7762b00 of size 1024
2019-11-20 08:23:15.293099: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7762f00 of size 1024
2019-11-20 08:23:15.293103: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7763300 of size 1024
2019-11-20 08:23:15.293107: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7763700 of size 1024
2019-11-20 08:23:15.293112: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7763b00 of size 2048
2019-11-20 08:23:15.293116: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7764300 of size 2048
2019-11-20 08:23:15.293120: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7764b00 of size 2048
2019-11-20 08:23:15.293124: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7765300 of size 2048
2019-11-20 08:23:15.293128: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7765b00 of size 2048
2019-11-20 08:23:15.293133: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7766300 of size 2048
2019-11-20 08:23:15.293137: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7766b00 of size 1024
2019-11-20 08:23:15.293141: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7766f00 of size 1024
2019-11-20 08:23:15.293146: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7767300 of size 512
2019-11-20 08:23:15.293150: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7767500 of size 512
2019-11-20 08:23:15.293154: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7767700 of size 256
2019-11-20 08:23:15.293158: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7767800 of size 256
2019-11-20 08:23:15.293162: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7767900 of size 256
2019-11-20 08:23:15.293167: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7767a00 of size 256
2019-11-20 08:23:15.293171: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7767b00 of size 256
2019-11-20 08:23:15.293175: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7767c00 of size 256
2019-11-20 08:23:15.293179: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7767d00 of size 256
2019-11-20 08:23:15.293183: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7767e00 of size 512
2019-11-20 08:23:15.293187: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7768000 of size 512
2019-11-20 08:23:15.293191: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7768200 of size 512
2019-11-20 08:23:15.293196: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7768400 of size 512
2019-11-20 08:23:15.293200: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7768600 of size 1024
2019-11-20 08:23:15.293204: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7768a00 of size 1024
2019-11-20 08:23:15.293208: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7768e00 of size 1024
2019-11-20 08:23:15.293213: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7769200 of size 1024
2019-11-20 08:23:15.293217: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7769600 of size 2048
2019-11-20 08:23:15.293221: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7769e00 of size 2048
2019-11-20 08:23:15.293225: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c776a600 of size 2048
2019-11-20 08:23:15.293229: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c776ae00 of size 2048
2019-11-20 08:23:15.293233: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Free at 0x7fd5c776b600 of size 277432832
2019-11-20 08:23:15.293238: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd652000000 of size 4155392
2019-11-20 08:23:15.293242: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6523f6800 of size 256
2019-11-20 08:23:15.293246: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6523f6900 of size 256
2019-11-20 08:23:15.293251: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6523f6a00 of size 8310784
2019-11-20 08:23:15.293255: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd652be3a00 of size 256
2019-11-20 08:23:15.293259: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd652be3b00 of size 256
2019-11-20 08:23:15.293263: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd652be3c00 of size 4155392
2019-11-20 08:23:15.293268: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd652fda400 of size 65536
2019-11-20 08:23:15.293272: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd652fea400 of size 589824
2019-11-20 08:23:15.293276: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65307a400 of size 32768
2019-11-20 08:23:15.293281: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd653082400 of size 294912
2019-11-20 08:23:15.293285: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6530ca400 of size 147456
2019-11-20 08:23:15.293290: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6530ee400 of size 16384
2019-11-20 08:23:15.293294: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6530f2400 of size 221184
2019-11-20 08:23:15.293298: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd653128400 of size 442368
2019-11-20 08:23:15.293303: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd653194400 of size 110592
2019-11-20 08:23:15.293307: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6531af400 of size 165888
2019-11-20 08:23:15.293311: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6531d7c00 of size 331776
2019-11-20 08:23:15.293316: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd653228c00 of size 82944
2019-11-20 08:23:15.293320: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65323d000 of size 1179648
2019-11-20 08:23:15.293325: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65335d000 of size 131072
2019-11-20 08:23:15.293329: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65337d000 of size 262144
2019-11-20 08:23:15.293333: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6533bd000 of size 4718592
2019-11-20 08:23:15.293338: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65383d000 of size 1048576
2019-11-20 08:23:15.293342: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65393d000 of size 4194304
2019-11-20 08:23:15.293346: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd653d3d000 of size 18874368
2019-11-20 08:23:15.293351: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd654f3d000 of size 1048576
2019-11-20 08:23:15.293355: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65503d000 of size 9437184
2019-11-20 08:23:15.293359: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593d000 of size 256
2019-11-20 08:23:15.293363: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593d100 of size 256
2019-11-20 08:23:15.293368: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593d200 of size 256
2019-11-20 08:23:15.293372: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593d300 of size 256
2019-11-20 08:23:15.293376: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593d400 of size 256
2019-11-20 08:23:15.293380: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593d500 of size 256
2019-11-20 08:23:15.293384: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593d600 of size 256
2019-11-20 08:23:15.293389: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593d700 of size 256
2019-11-20 08:23:15.293393: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593d800 of size 256
2019-11-20 08:23:15.293397: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593d900 of size 256
2019-11-20 08:23:15.293401: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593da00 of size 256
2019-11-20 08:23:15.293405: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593db00 of size 256
2019-11-20 08:23:15.293409: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593dc00 of size 256
2019-11-20 08:23:15.293414: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593dd00 of size 256
2019-11-20 08:23:15.293418: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593de00 of size 256
2019-11-20 08:23:15.293422: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593df00 of size 256
2019-11-20 08:23:15.293426: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593e000 of size 256
2019-11-20 08:23:15.293430: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593e100 of size 256
2019-11-20 08:23:15.293434: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593e200 of size 256
2019-11-20 08:23:15.293438: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593e300 of size 256
2019-11-20 08:23:15.293443: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593e400 of size 256
2019-11-20 08:23:15.293447: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593e500 of size 256
2019-11-20 08:23:15.293451: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593e600 of size 256
2019-11-20 08:23:15.293455: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593e700 of size 256
2019-11-20 08:23:15.293459: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593e800 of size 256
2019-11-20 08:23:15.293463: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593e900 of size 256
2019-11-20 08:23:15.293468: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593ea00 of size 7680
2019-11-20 08:23:15.293472: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd655940800 of size 26112
2019-11-20 08:23:15.293477: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd655946e00 of size 98048
2019-11-20 08:23:15.293481: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65595ed00 of size 391680
2019-11-20 08:23:15.293485: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6559be700 of size 1566720
2019-11-20 08:23:15.293489: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd655b3cf00 of size 6220800
2019-11-20 08:23:15.293494: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65612bb00 of size 256
2019-11-20 08:23:15.293498: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65612bc00 of size 256
2019-11-20 08:23:15.293502: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65612bd00 of size 256
2019-11-20 08:23:15.293506: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65612be00 of size 256
2019-11-20 08:23:15.293510: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65612bf00 of size 256
2019-11-20 08:23:15.293515: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65612c000 of size 256
2019-11-20 08:23:15.293519: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Free at 0x7fd65612c100 of size 468532992
2019-11-20 08:23:15.293524: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd690000000 of size 2359296
2019-11-20 08:23:15.293528: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd690240000 of size 2359296
2019-11-20 08:23:15.293532: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd690480000 of size 2359296
2019-11-20 08:23:15.293536: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6906c0000 of size 2359296
2019-11-20 08:23:15.293541: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd690900000 of size 2359296
2019-11-20 08:23:15.293545: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd690b40000 of size 2359296
2019-11-20 08:23:15.293549: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd690d80000 of size 1024
2019-11-20 08:23:15.293554: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd690d80400 of size 1024
2019-11-20 08:23:15.293558: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd690d80800 of size 1024
2019-11-20 08:23:15.293562: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd690d80c00 of size 1024
2019-11-20 08:23:15.293579: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd690d81000 of size 1024
2019-11-20 08:23:15.293583: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd690d81400 of size 1024
2019-11-20 08:23:15.293587: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd690d81800 of size 1024
2019-11-20 08:23:15.293591: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd690d81c00 of size 1024
2019-11-20 08:23:15.293595: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd690d82000 of size 1179648
2019-11-20 08:23:15.293599: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd690ea2000 of size 1179648
2019-11-20 08:23:15.293603: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd690fc2000 of size 1179648
2019-11-20 08:23:15.293607: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6910e2000 of size 1179648
2019-11-20 08:23:15.293611: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691202000 of size 1179648
2019-11-20 08:23:15.293615: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691322000 of size 1179648
2019-11-20 08:23:15.293619: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691442000 of size 1179648
2019-11-20 08:23:15.293623: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691562000 of size 1179648
2019-11-20 08:23:15.293627: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691682000 of size 1179648
2019-11-20 08:23:15.293631: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6917a2000 of size 1179648
2019-11-20 08:23:15.293635: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6918c2000 of size 1179648
2019-11-20 08:23:15.293639: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6919e2000 of size 1179648
2019-11-20 08:23:15.293643: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691b02000 of size 1179648
2019-11-20 08:23:15.293646: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c22000 of size 1024
2019-11-20 08:23:15.293651: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c22400 of size 1024
2019-11-20 08:23:15.293655: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c22800 of size 1024
2019-11-20 08:23:15.293659: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c22c00 of size 1024
2019-11-20 08:23:15.293662: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c23000 of size 1024
2019-11-20 08:23:15.293666: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c23400 of size 1024
2019-11-20 08:23:15.293670: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c23800 of size 1024
2019-11-20 08:23:15.293674: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c23c00 of size 1024
2019-11-20 08:23:15.293678: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c24000 of size 1024
2019-11-20 08:23:15.293682: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c24400 of size 1024
2019-11-20 08:23:15.293688: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c24800 of size 1024
2019-11-20 08:23:15.293692: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c24c00 of size 1024
2019-11-20 08:23:15.293696: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c25000 of size 1024
2019-11-20 08:23:15.293700: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c25400 of size 1024
2019-11-20 08:23:15.293704: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c25800 of size 1024
2019-11-20 08:23:15.293708: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c25c00 of size 1024
2019-11-20 08:23:15.293712: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c26000 of size 1024
2019-11-20 08:23:15.293716: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c26400 of size 1024
2019-11-20 08:23:15.293720: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c26800 of size 1024
2019-11-20 08:23:15.293724: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c26c00 of size 1024
2019-11-20 08:23:15.293728: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c27000 of size 1024
2019-11-20 08:23:15.293732: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c27400 of size 1024
2019-11-20 08:23:15.293736: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c27800 of size 1024
2019-11-20 08:23:15.293740: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c27c00 of size 1024
2019-11-20 08:23:15.293744: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c28000 of size 1024
2019-11-20 08:23:15.293748: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c28400 of size 1024
2019-11-20 08:23:15.293752: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c28800 of size 1024
2019-11-20 08:23:15.293756: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c28c00 of size 1024
2019-11-20 08:23:15.293760: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c29000 of size 1024
2019-11-20 08:23:15.293764: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c29400 of size 1024
2019-11-20 08:23:15.293767: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c29800 of size 1024
2019-11-20 08:23:15.293771: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c29c00 of size 1024
2019-11-20 08:23:15.293775: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2a000 of size 1024
2019-11-20 08:23:15.293779: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2a400 of size 1024
2019-11-20 08:23:15.293783: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2a800 of size 1024
2019-11-20 08:23:15.293787: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2ac00 of size 1024
2019-11-20 08:23:15.293791: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2b000 of size 1024
2019-11-20 08:23:15.293796: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2b400 of size 1024
2019-11-20 08:23:15.293800: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2b800 of size 1024
2019-11-20 08:23:15.293804: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2bc00 of size 1024
2019-11-20 08:23:15.293808: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2c000 of size 1024
2019-11-20 08:23:15.293812: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2c400 of size 1024
2019-11-20 08:23:15.293817: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2c800 of size 1024
2019-11-20 08:23:15.293821: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2cc00 of size 1024
2019-11-20 08:23:15.293826: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2d000 of size 1024
2019-11-20 08:23:15.293830: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2d400 of size 1024
2019-11-20 08:23:15.293834: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2d800 of size 1024
2019-11-20 08:23:15.293838: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2dc00 of size 1024
2019-11-20 08:23:15.293842: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2e000 of size 1024
2019-11-20 08:23:15.293847: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2e400 of size 1024
2019-11-20 08:23:15.293851: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2e800 of size 1024
2019-11-20 08:23:15.293855: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2ec00 of size 1024
2019-11-20 08:23:15.293859: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2f000 of size 65536
2019-11-20 08:23:15.293863: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c3f000 of size 65536
2019-11-20 08:23:15.293867: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c4f000 of size 65536
2019-11-20 08:23:15.293871: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c5f000 of size 65536
2019-11-20 08:23:15.293875: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c6f000 of size 512
2019-11-20 08:23:15.293879: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c6f200 of size 512
2019-11-20 08:23:15.293883: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c6f400 of size 512
2019-11-20 08:23:15.293887: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c6f600 of size 512
2019-11-20 08:23:15.293892: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c6f800 of size 589824
2019-11-20 08:23:15.293896: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691cff800 of size 589824
2019-11-20 08:23:15.293900: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691d8f800 of size 589824
2019-11-20 08:23:15.293904: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691e1f800 of size 589824
2019-11-20 08:23:15.293907: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691eaf800 of size 589824
2019-11-20 08:23:15.293911: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691f3f800 of size 589824
2019-11-20 08:23:15.293915: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691fcf800 of size 589824
2019-11-20 08:23:15.293919: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69205f800 of size 589824
2019-11-20 08:23:15.293923: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6920ef800 of size 589824
2019-11-20 08:23:15.293927: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69217f800 of size 589824
2019-11-20 08:23:15.293931: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69220f800 of size 589824
2019-11-20 08:23:15.293935: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69229f800 of size 589824
2019-11-20 08:23:15.293939: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69232f800 of size 512
2019-11-20 08:23:15.293943: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69232fa00 of size 512
2019-11-20 08:23:15.293947: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69232fc00 of size 512
2019-11-20 08:23:15.293951: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69232fe00 of size 512
2019-11-20 08:23:15.293955: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692330000 of size 512
2019-11-20 08:23:15.293960: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692330200 of size 512
2019-11-20 08:23:15.293964: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692330400 of size 512
2019-11-20 08:23:15.293968: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692330600 of size 512
2019-11-20 08:23:15.293972: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692330800 of size 512
2019-11-20 08:23:15.293976: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692330a00 of size 512
2019-11-20 08:23:15.293980: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692330c00 of size 512
2019-11-20 08:23:15.293984: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692330e00 of size 512
2019-11-20 08:23:15.293988: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692331000 of size 512
2019-11-20 08:23:15.293992: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692331200 of size 512
2019-11-20 08:23:15.293996: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692331400 of size 512
2019-11-20 08:23:15.294000: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692331600 of size 512
2019-11-20 08:23:15.294004: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692331800 of size 512
2019-11-20 08:23:15.294008: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692331a00 of size 512
2019-11-20 08:23:15.294012: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692331c00 of size 512
2019-11-20 08:23:15.294016: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692331e00 of size 512
2019-11-20 08:23:15.294020: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692332000 of size 512
2019-11-20 08:23:15.294024: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692332200 of size 512
2019-11-20 08:23:15.294028: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692332400 of size 512
2019-11-20 08:23:15.294032: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692332600 of size 512
2019-11-20 08:23:15.294036: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692332800 of size 512
2019-11-20 08:23:15.294040: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692332a00 of size 512
2019-11-20 08:23:15.294044: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692332c00 of size 512
2019-11-20 08:23:15.294048: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692332e00 of size 512
2019-11-20 08:23:15.294052: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692333000 of size 512
2019-11-20 08:23:15.294056: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692333200 of size 512
2019-11-20 08:23:15.294061: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692333400 of size 512
2019-11-20 08:23:15.294065: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692333600 of size 512
2019-11-20 08:23:15.294069: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692333800 of size 512
2019-11-20 08:23:15.294073: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692333a00 of size 512
2019-11-20 08:23:15.294077: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692333c00 of size 512
2019-11-20 08:23:15.294081: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692333e00 of size 512
2019-11-20 08:23:15.294085: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692334000 of size 512
2019-11-20 08:23:15.294089: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692334200 of size 512
2019-11-20 08:23:15.294093: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692334400 of size 512
2019-11-20 08:23:15.294097: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692334600 of size 512
2019-11-20 08:23:15.294102: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692334800 of size 512
2019-11-20 08:23:15.294106: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692334a00 of size 512
2019-11-20 08:23:15.294110: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692334c00 of size 512
2019-11-20 08:23:15.294113: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692334e00 of size 512
2019-11-20 08:23:15.294117: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692335000 of size 512
2019-11-20 08:23:15.294121: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692335200 of size 512
2019-11-20 08:23:15.294125: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692335400 of size 512
2019-11-20 08:23:15.294129: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692335600 of size 512
2019-11-20 08:23:15.294133: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692335800 of size 512
2019-11-20 08:23:15.294137: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692335a00 of size 512
2019-11-20 08:23:15.294141: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692335c00 of size 512
2019-11-20 08:23:15.294145: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692335e00 of size 512
2019-11-20 08:23:15.294149: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692336000 of size 512
2019-11-20 08:23:15.294153: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692336200 of size 512
2019-11-20 08:23:15.294157: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692336400 of size 512
2019-11-20 08:23:15.294161: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692336600 of size 512
2019-11-20 08:23:15.294165: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692336800 of size 32768
2019-11-20 08:23:15.294169: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69233e800 of size 32768
2019-11-20 08:23:15.294173: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692346800 of size 32768
2019-11-20 08:23:15.294177: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69234e800 of size 32768
2019-11-20 08:23:15.294181: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692356800 of size 512
2019-11-20 08:23:15.294185: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692356a00 of size 512
2019-11-20 08:23:15.294189: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692356c00 of size 512
2019-11-20 08:23:15.294193: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692356e00 of size 512
2019-11-20 08:23:15.294197: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692357000 of size 512
2019-11-20 08:23:15.294201: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692357200 of size 512
2019-11-20 08:23:15.294205: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692357400 of size 512
2019-11-20 08:23:15.294209: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692357600 of size 512
2019-11-20 08:23:15.294213: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692357800 of size 294912
2019-11-20 08:23:15.294217: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69239f800 of size 294912
2019-11-20 08:23:15.294221: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6923e7800 of size 294912
2019-11-20 08:23:15.294225: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69242f800 of size 294912
2019-11-20 08:23:15.294229: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692477800 of size 512
2019-11-20 08:23:15.294234: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692477a00 of size 512
2019-11-20 08:23:15.294238: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692477c00 of size 512
2019-11-20 08:23:15.294242: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692477e00 of size 512
2019-11-20 08:23:15.294246: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692478000 of size 512
2019-11-20 08:23:15.294250: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692478200 of size 512
2019-11-20 08:23:15.294254: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692478400 of size 512
2019-11-20 08:23:15.294258: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692478600 of size 512
2019-11-20 08:23:15.294262: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692478800 of size 512
2019-11-20 08:23:15.294266: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692478a00 of size 512
2019-11-20 08:23:15.294270: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692478c00 of size 512
2019-11-20 08:23:15.294274: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692478e00 of size 512
2019-11-20 08:23:15.294278: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692479000 of size 512
2019-11-20 08:23:15.294282: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692479200 of size 512
2019-11-20 08:23:15.294286: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692479400 of size 512
2019-11-20 08:23:15.294290: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692479600 of size 512
2019-11-20 08:23:15.294294: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692479800 of size 512
2019-11-20 08:23:15.294298: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692479a00 of size 512
2019-11-20 08:23:15.294302: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692479c00 of size 512
2019-11-20 08:23:15.294306: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692479e00 of size 512
2019-11-20 08:23:15.294310: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247a000 of size 512
2019-11-20 08:23:15.294314: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247a200 of size 512
2019-11-20 08:23:15.294318: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247a400 of size 512
2019-11-20 08:23:15.294322: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247a600 of size 512
2019-11-20 08:23:15.294326: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247a800 of size 512
2019-11-20 08:23:15.294330: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247aa00 of size 512
2019-11-20 08:23:15.294334: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247ac00 of size 512
2019-11-20 08:23:15.294338: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247ae00 of size 512
2019-11-20 08:23:15.294342: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247b000 of size 512
2019-11-20 08:23:15.294346: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247b200 of size 512
2019-11-20 08:23:15.294350: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247b400 of size 512
2019-11-20 08:23:15.294354: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247b600 of size 512
2019-11-20 08:23:15.294358: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247b800 of size 512
2019-11-20 08:23:15.294362: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247ba00 of size 512
2019-11-20 08:23:15.294366: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247bc00 of size 512
2019-11-20 08:23:15.294370: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247be00 of size 512
2019-11-20 08:23:15.294375: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247c000 of size 512
2019-11-20 08:23:15.294379: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247c200 of size 512
2019-11-20 08:23:15.294383: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247c400 of size 512
2019-11-20 08:23:15.294386: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247c600 of size 512
2019-11-20 08:23:15.294390: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247c800 of size 512
2019-11-20 08:23:15.294394: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247ca00 of size 512
2019-11-20 08:23:15.294398: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247cc00 of size 512
2019-11-20 08:23:15.294402: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247ce00 of size 512
2019-11-20 08:23:15.294406: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247d000 of size 512
2019-11-20 08:23:15.294410: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247d200 of size 512
2019-11-20 08:23:15.294415: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247d400 of size 512
2019-11-20 08:23:15.294419: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247d600 of size 512
2019-11-20 08:23:15.294423: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247d800 of size 512
2019-11-20 08:23:15.294427: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247da00 of size 512
2019-11-20 08:23:15.294431: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247dc00 of size 512
2019-11-20 08:23:15.294435: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247de00 of size 512
2019-11-20 08:23:15.294439: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247e000 of size 16384
2019-11-20 08:23:15.294443: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692482000 of size 16384
2019-11-20 08:23:15.294447: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692486000 of size 16384
2019-11-20 08:23:15.294466: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69248a000 of size 16384
2019-11-20 08:23:15.294470: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69248e000 of size 16384
2019-11-20 08:23:15.294475: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692492000 of size 16384
2019-11-20 08:23:15.294479: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692496000 of size 16384
2019-11-20 08:23:15.294483: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69249a000 of size 16384
2019-11-20 08:23:15.294488: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69249e000 of size 256
2019-11-20 08:23:15.294492: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69249e100 of size 256
2019-11-20 08:23:15.294496: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69249e200 of size 256
2019-11-20 08:23:15.294500: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69249e300 of size 256
2019-11-20 08:23:15.294505: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69249e400 of size 147456
2019-11-20 08:23:15.294509: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6924c2400 of size 147456
2019-11-20 08:23:15.294526: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6924e6400 of size 147456
2019-11-20 08:23:15.294530: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69250a400 of size 147456
2019-11-20 08:23:15.294550: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69252e400 of size 147456
2019-11-20 08:23:15.294555: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692552400 of size 147456
2019-11-20 08:23:15.294559: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692576400 of size 147456
2019-11-20 08:23:15.294563: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69259a400 of size 147456
2019-11-20 08:23:15.294567: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6925be400 of size 147456
2019-11-20 08:23:15.294572: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6925e2400 of size 147456
2019-11-20 08:23:15.294576: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692606400 of size 147456
2019-11-20 08:23:15.294593: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69262a400 of size 147456
2019-11-20 08:23:15.294597: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69264e400 of size 147456
2019-11-20 08:23:15.294619: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692672400 of size 147456
2019-11-20 08:23:15.294623: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692696400 of size 147456
2019-11-20 08:23:15.294627: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926ba400 of size 147456
2019-11-20 08:23:15.294631: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926de400 of size 256
2019-11-20 08:23:15.294635: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926de500 of size 256
2019-11-20 08:23:15.294639: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926de600 of size 256
2019-11-20 08:23:15.294644: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926de700 of size 256
2019-11-20 08:23:15.294661: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926de800 of size 256
2019-11-20 08:23:15.294665: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926de900 of size 256
2019-11-20 08:23:15.294684: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926dea00 of size 256
2019-11-20 08:23:15.294688: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926deb00 of size 256
2019-11-20 08:23:15.294692: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926dec00 of size 256
2019-11-20 08:23:15.294697: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926ded00 of size 256
2019-11-20 08:23:15.294701: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926dee00 of size 256
2019-11-20 08:23:15.294717: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926def00 of size 256
2019-11-20 08:23:15.294721: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926df000 of size 256
2019-11-20 08:23:15.294725: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926df100 of size 256
2019-11-20 08:23:15.294729: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926df200 of size 256
2019-11-20 08:23:15.294733: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926df300 of size 256
2019-11-20 08:23:15.294737: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926df400 of size 256
2019-11-20 08:23:15.294742: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926df500 of size 256
2019-11-20 08:23:15.294746: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926df600 of size 256
2019-11-20 08:23:15.294750: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926df700 of size 256
2019-11-20 08:23:15.294754: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926df800 of size 256
2019-11-20 08:23:15.294758: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926df900 of size 256
2019-11-20 08:23:15.294762: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926dfa00 of size 256
2019-11-20 08:23:15.294766: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926dfb00 of size 256
2019-11-20 08:23:15.294770: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926dfc00 of size 256
2019-11-20 08:23:15.294774: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926dfd00 of size 256
2019-11-20 08:23:15.294778: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926dfe00 of size 256
2019-11-20 08:23:15.294783: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926dff00 of size 256
2019-11-20 08:23:15.294787: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e0000 of size 256
2019-11-20 08:23:15.294791: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e0100 of size 256
2019-11-20 08:23:15.294795: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e0200 of size 256
2019-11-20 08:23:15.294799: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e0300 of size 256
2019-11-20 08:23:15.294803: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e0400 of size 256
2019-11-20 08:23:15.294807: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e0500 of size 256
2019-11-20 08:23:15.294811: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e0600 of size 256
2019-11-20 08:23:15.294815: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e0700 of size 256
2019-11-20 08:23:15.294819: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e0800 of size 256
2019-11-20 08:23:15.294823: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e0900 of size 256
2019-11-20 08:23:15.294827: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e0a00 of size 256
2019-11-20 08:23:15.294831: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e0b00 of size 256
2019-11-20 08:23:15.294835: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e0c00 of size 256
2019-11-20 08:23:15.294839: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e0d00 of size 256
2019-11-20 08:23:15.294843: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e0e00 of size 256
2019-11-20 08:23:15.294847: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e0f00 of size 256
2019-11-20 08:23:15.294851: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e1000 of size 256
2019-11-20 08:23:15.294855: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e1100 of size 256
2019-11-20 08:23:15.294860: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e1200 of size 256
2019-11-20 08:23:15.294864: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e1300 of size 256
2019-11-20 08:23:15.294867: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e1400 of size 256
2019-11-20 08:23:15.294871: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e1500 of size 256
2019-11-20 08:23:15.294875: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e1600 of size 256
2019-11-20 08:23:15.294879: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e1700 of size 256
2019-11-20 08:23:15.294883: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e1800 of size 256
2019-11-20 08:23:15.294887: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e1900 of size 256
2019-11-20 08:23:15.294891: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e1a00 of size 256
2019-11-20 08:23:15.294895: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e1b00 of size 256
2019-11-20 08:23:15.294899: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e1c00 of size 256
2019-11-20 08:23:15.294904: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e1d00 of size 256
2019-11-20 08:23:15.294908: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e1e00 of size 256
2019-11-20 08:23:15.294912: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e1f00 of size 256
2019-11-20 08:23:15.294916: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e2000 of size 256
2019-11-20 08:23:15.294920: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e2100 of size 256
2019-11-20 08:23:15.294924: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e2200 of size 256
2019-11-20 08:23:15.294928: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e2300 of size 256
2019-11-20 08:23:15.294932: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e2400 of size 256
2019-11-20 08:23:15.294936: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e2500 of size 256
2019-11-20 08:23:15.294940: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e2600 of size 256
2019-11-20 08:23:15.294944: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e2700 of size 256
2019-11-20 08:23:15.294948: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e2800 of size 256
2019-11-20 08:23:15.294952: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e2900 of size 256
2019-11-20 08:23:15.294956: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e2a00 of size 256
2019-11-20 08:23:15.294960: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e2b00 of size 256
2019-11-20 08:23:15.294964: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e2c00 of size 256
2019-11-20 08:23:15.294968: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e2d00 of size 256
2019-11-20 08:23:15.294972: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e2e00 of size 256
2019-11-20 08:23:15.294976: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e2f00 of size 256
2019-11-20 08:23:15.294980: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e3000 of size 256
2019-11-20 08:23:15.294984: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e3100 of size 256
2019-11-20 08:23:15.294988: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e3200 of size 256
2019-11-20 08:23:15.294992: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e3300 of size 256
2019-11-20 08:23:15.294996: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e3400 of size 256
2019-11-20 08:23:15.295001: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e3500 of size 256
2019-11-20 08:23:15.295005: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e3600 of size 256
2019-11-20 08:23:15.295009: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e3700 of size 256
2019-11-20 08:23:15.295013: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e3800 of size 256
2019-11-20 08:23:15.295017: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e3900 of size 256
2019-11-20 08:23:15.295021: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e3a00 of size 256
2019-11-20 08:23:15.295025: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e3b00 of size 256
2019-11-20 08:23:15.295029: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e3c00 of size 256
2019-11-20 08:23:15.295033: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e3d00 of size 256
2019-11-20 08:23:15.295037: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e3e00 of size 256
2019-11-20 08:23:15.295041: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e3f00 of size 256
2019-11-20 08:23:15.295045: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e4000 of size 256
2019-11-20 08:23:15.295049: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e4100 of size 256
2019-11-20 08:23:15.295053: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e4200 of size 256
2019-11-20 08:23:15.295057: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e4300 of size 256
2019-11-20 08:23:15.295061: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e4400 of size 256
2019-11-20 08:23:15.295065: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e4500 of size 256
2019-11-20 08:23:15.295069: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e4600 of size 256
2019-11-20 08:23:15.295073: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e4700 of size 256
2019-11-20 08:23:15.295077: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e4800 of size 256
2019-11-20 08:23:15.295081: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e4900 of size 256
2019-11-20 08:23:15.295085: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e4a00 of size 256
2019-11-20 08:23:15.295089: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e4b00 of size 256
2019-11-20 08:23:15.295093: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e4c00 of size 256
2019-11-20 08:23:15.295097: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e4d00 of size 256
2019-11-20 08:23:15.295101: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e4e00 of size 256
2019-11-20 08:23:15.295105: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e4f00 of size 256
2019-11-20 08:23:15.295109: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e5000 of size 256
2019-11-20 08:23:15.295113: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e5100 of

[quote=“”]

[code]
Epoch 00009: saving model to /workspace/tlt-experiments/experiment_dir_unpruned/weights/ssd_resnet18_epoch_009.tlt
Epoch 10/180
1283/1283 [==============================] - 404s 315ms/step - loss: 0.0031

Epoch 00010: saving model to /workspace/tlt-experiments/experiment_dir_unpruned/weights/ssd_resnet18_epoch_010.tlt
WARNING:tensorflow:From ./ssd/box_coder/output_decoder_layer.py:83: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use tf.cast instead.
2019-11-20 08:22:58,086 [WARNING] tensorflow: From ./ssd/box_coder/output_decoder_layer.py:83: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use tf.cast instead.
Number of images in the evaluation dataset: 417
()
Producing predictions batch-wise: 0% 0/14 [00:00<?, ?it/s]2019-11-20 08:23:15.292786: W tensorflow/core/common_runtime/bfc_allocator.cc:267] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.96GiB. Current allocation summary follows.
2019-11-20 08:23:15.292838: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (256): Total Chunks: 425, Chunks in use: 425. 106.2KiB allocated for chunks. 106.2KiB in use in bin. 55.3KiB client-requested in use in bin.
2019-11-20 08:23:15.292846: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (512): Total Chunks: 188, Chunks in use: 188. 95.0KiB allocated for chunks. 95.0KiB in use in bin. 94.8KiB client-requested in use in bin.
2019-11-20 08:23:15.292853: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (1024): Total Chunks: 189, Chunks in use: 189. 189.2KiB allocated for chunks. 189.2KiB in use in bin. 189.0KiB client-requested in use in bin.
2019-11-20 08:23:15.292858: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (2048): Total Chunks: 176, Chunks in use: 176. 352.0KiB allocated for chunks. 352.0KiB in use in bin. 352.0KiB client-requested in use in bin.
2019-11-20 08:23:15.292864: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (4096): Total Chunks: 11, Chunks in use: 11. 47.5KiB allocated for chunks. 47.5KiB in use in bin. 47.5KiB client-requested in use in bin.
2019-11-20 08:23:15.292869: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (8192): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin.
2019-11-20 08:23:15.292875: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (16384): Total Chunks: 16, Chunks in use: 16. 265.5KiB allocated for chunks. 265.5KiB in use in bin. 265.3KiB client-requested in use in bin.
2019-11-20 08:23:15.292881: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (32768): Total Chunks: 15, Chunks in use: 15. 508.5KiB allocated for chunks. 508.5KiB in use in bin. 508.5KiB client-requested in use in bin.
2019-11-20 08:23:15.292886: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (65536): Total Chunks: 22, Chunks in use: 22. 1.76MiB allocated for chunks. 1.76MiB in use in bin. 1.76MiB client-requested in use in bin.
2019-11-20 08:23:15.292892: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (131072): Total Chunks: 73, Chunks in use: 73. 11.16MiB allocated for chunks. 11.16MiB in use in bin. 11.13MiB client-requested in use in bin.
2019-11-20 08:23:15.292898: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (262144): Total Chunks: 47, Chunks in use: 47. 14.67MiB allocated for chunks. 14.67MiB in use in bin. 14.54MiB client-requested in use in bin.
2019-11-20 08:23:15.292921: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (524288): Total Chunks: 32, Chunks in use: 32. 17.40MiB allocated for chunks. 17.40MiB in use in bin. 17.05MiB client-requested in use in bin.
2019-11-20 08:23:15.292927: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (1048576): Total Chunks: 37, Chunks in use: 37. 40.12MiB allocated for chunks. 40.12MiB in use in bin. 40.12MiB client-requested in use in bin.
2019-11-20 08:23:15.292933: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (2097152): Total Chunks: 23, Chunks in use: 23. 55.90MiB allocated for chunks. 55.90MiB in use in bin. 55.90MiB client-requested in use in bin.
2019-11-20 08:23:15.292939: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (4194304): Total Chunks: 22, Chunks in use: 22. 102.44MiB allocated for chunks. 102.44MiB in use in bin. 98.61MiB client-requested in use in bin.
2019-11-20 08:23:15.292944: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (8388608): Total Chunks: 21, Chunks in use: 21. 190.00MiB allocated for chunks. 190.00MiB in use in bin. 189.00MiB client-requested in use in bin.
2019-11-20 08:23:15.292950: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (16777216): Total Chunks: 6, Chunks in use: 6. 109.23MiB allocated for chunks. 109.23MiB in use in bin. 104.86MiB client-requested in use in bin.
2019-11-20 08:23:15.292956: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (33554432): Total Chunks: 1, Chunks in use: 1. 32.00MiB allocated for chunks. 32.00MiB in use in bin. 18.00MiB client-requested in use in bin.
2019-11-20 08:23:15.292961: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (67108864): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin.
2019-11-20 08:23:15.292966: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (134217728): Total Chunks: 0, Chunks in use: 0. 0B allocated for chunks. 0B in use in bin. 0B client-requested in use in bin.
2019-11-20 08:23:15.292972: I tensorflow/core/common_runtime/bfc_allocator.cc:597] Bin (268435456): Total Chunks: 5, Chunks in use: 1. 4.19GiB allocated for chunks. 765.98MiB in use in bin. 765.98MiB client-requested in use in bin.
2019-11-20 08:23:15.292977: I tensorflow/core/common_runtime/bfc_allocator.cc:613] Bin for 3.96GiB was 256.00MiB, Chunk State:
2019-11-20 08:23:15.292985: I tensorflow/core/common_runtime/bfc_allocator.cc:619] Size: 264.58MiB | Requested Size: 16B | in_use: 0, prev: Size: 2.0KiB | Requested Size: 2.0KiB | in_use: 1
2019-11-20 08:23:15.292991: I tensorflow/core/common_runtime/bfc_allocator.cc:619] Size: 446.83MiB | Requested Size: 23.73MiB | in_use: 0, prev: Size: 256B | Requested Size: 24B | in_use: 1
2019-11-20 08:23:15.292998: I tensorflow/core/common_runtime/bfc_allocator.cc:619] Size: 759.38MiB | Requested Size: 759.38MiB | in_use: 0, next: Size: 2.0KiB | Requested Size: 2.0KiB | in_use: 1
2019-11-20 08:23:15.293004: I tensorflow/core/common_runtime/bfc_allocator.cc:619] Size: 2.01GiB | Requested Size: 23.73MiB | in_use: 0, prev: Size: 765.98MiB | Requested Size: 765.98MiB | in_use: 1
2019-11-20 08:23:15.293010: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd4e6000000 of size 803188224
2019-11-20 08:23:15.293015: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Free at 0x7fd515dfae00 of size 2158082048
2019-11-20 08:23:15.293019: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Free at 0x7fd598000000 of size 796262400
2019-11-20 08:23:15.293024: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7760000 of size 2048
2019-11-20 08:23:15.293028: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7760800 of size 2048
2019-11-20 08:23:15.293032: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7761000 of size 1024
2019-11-20 08:23:15.293036: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7761400 of size 1024
2019-11-20 08:23:15.293041: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7761800 of size 512
2019-11-20 08:23:15.293045: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7761a00 of size 512
2019-11-20 08:23:15.293049: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7761c00 of size 256
2019-11-20 08:23:15.293053: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7761d00 of size 256
2019-11-20 08:23:15.293058: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7761e00 of size 256
2019-11-20 08:23:15.293062: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7761f00 of size 256
2019-11-20 08:23:15.293066: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7762000 of size 256
2019-11-20 08:23:15.293070: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7762100 of size 256
2019-11-20 08:23:15.293074: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7762200 of size 256
2019-11-20 08:23:15.293078: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7762300 of size 512
2019-11-20 08:23:15.293083: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7762500 of size 512
2019-11-20 08:23:15.293087: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7762700 of size 512
2019-11-20 08:23:15.293091: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7762900 of size 512
2019-11-20 08:23:15.293095: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7762b00 of size 1024
2019-11-20 08:23:15.293099: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7762f00 of size 1024
2019-11-20 08:23:15.293103: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7763300 of size 1024
2019-11-20 08:23:15.293107: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7763700 of size 1024
2019-11-20 08:23:15.293112: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7763b00 of size 2048
2019-11-20 08:23:15.293116: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7764300 of size 2048
2019-11-20 08:23:15.293120: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7764b00 of size 2048
2019-11-20 08:23:15.293124: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7765300 of size 2048
2019-11-20 08:23:15.293128: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7765b00 of size 2048
2019-11-20 08:23:15.293133: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7766300 of size 2048
2019-11-20 08:23:15.293137: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7766b00 of size 1024
2019-11-20 08:23:15.293141: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7766f00 of size 1024
2019-11-20 08:23:15.293146: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7767300 of size 512
2019-11-20 08:23:15.293150: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7767500 of size 512
2019-11-20 08:23:15.293154: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7767700 of size 256
2019-11-20 08:23:15.293158: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7767800 of size 256
2019-11-20 08:23:15.293162: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7767900 of size 256
2019-11-20 08:23:15.293167: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7767a00 of size 256
2019-11-20 08:23:15.293171: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7767b00 of size 256
2019-11-20 08:23:15.293175: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7767c00 of size 256
2019-11-20 08:23:15.293179: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7767d00 of size 256
2019-11-20 08:23:15.293183: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7767e00 of size 512
2019-11-20 08:23:15.293187: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7768000 of size 512
2019-11-20 08:23:15.293191: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7768200 of size 512
2019-11-20 08:23:15.293196: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7768400 of size 512
2019-11-20 08:23:15.293200: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7768600 of size 1024
2019-11-20 08:23:15.293204: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7768a00 of size 1024
2019-11-20 08:23:15.293208: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7768e00 of size 1024
2019-11-20 08:23:15.293213: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7769200 of size 1024
2019-11-20 08:23:15.293217: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7769600 of size 2048
2019-11-20 08:23:15.293221: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c7769e00 of size 2048
2019-11-20 08:23:15.293225: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c776a600 of size 2048
2019-11-20 08:23:15.293229: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd5c776ae00 of size 2048
2019-11-20 08:23:15.293233: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Free at 0x7fd5c776b600 of size 277432832
2019-11-20 08:23:15.293238: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd652000000 of size 4155392
2019-11-20 08:23:15.293242: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6523f6800 of size 256
2019-11-20 08:23:15.293246: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6523f6900 of size 256
2019-11-20 08:23:15.293251: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6523f6a00 of size 8310784
2019-11-20 08:23:15.293255: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd652be3a00 of size 256
2019-11-20 08:23:15.293259: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd652be3b00 of size 256
2019-11-20 08:23:15.293263: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd652be3c00 of size 4155392
2019-11-20 08:23:15.293268: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd652fda400 of size 65536
2019-11-20 08:23:15.293272: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd652fea400 of size 589824
2019-11-20 08:23:15.293276: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65307a400 of size 32768
2019-11-20 08:23:15.293281: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd653082400 of size 294912
2019-11-20 08:23:15.293285: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6530ca400 of size 147456
2019-11-20 08:23:15.293290: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6530ee400 of size 16384
2019-11-20 08:23:15.293294: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6530f2400 of size 221184
2019-11-20 08:23:15.293298: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd653128400 of size 442368
2019-11-20 08:23:15.293303: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd653194400 of size 110592
2019-11-20 08:23:15.293307: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6531af400 of size 165888
2019-11-20 08:23:15.293311: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6531d7c00 of size 331776
2019-11-20 08:23:15.293316: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd653228c00 of size 82944
2019-11-20 08:23:15.293320: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65323d000 of size 1179648
2019-11-20 08:23:15.293325: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65335d000 of size 131072
2019-11-20 08:23:15.293329: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65337d000 of size 262144
2019-11-20 08:23:15.293333: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6533bd000 of size 4718592
2019-11-20 08:23:15.293338: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65383d000 of size 1048576
2019-11-20 08:23:15.293342: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65393d000 of size 4194304
2019-11-20 08:23:15.293346: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd653d3d000 of size 18874368
2019-11-20 08:23:15.293351: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd654f3d000 of size 1048576
2019-11-20 08:23:15.293355: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65503d000 of size 9437184
2019-11-20 08:23:15.293359: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593d000 of size 256
2019-11-20 08:23:15.293363: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593d100 of size 256
2019-11-20 08:23:15.293368: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593d200 of size 256
2019-11-20 08:23:15.293372: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593d300 of size 256
2019-11-20 08:23:15.293376: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593d400 of size 256
2019-11-20 08:23:15.293380: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593d500 of size 256
2019-11-20 08:23:15.293384: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593d600 of size 256
2019-11-20 08:23:15.293389: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593d700 of size 256
2019-11-20 08:23:15.293393: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593d800 of size 256
2019-11-20 08:23:15.293397: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593d900 of size 256
2019-11-20 08:23:15.293401: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593da00 of size 256
2019-11-20 08:23:15.293405: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593db00 of size 256
2019-11-20 08:23:15.293409: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593dc00 of size 256
2019-11-20 08:23:15.293414: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593dd00 of size 256
2019-11-20 08:23:15.293418: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593de00 of size 256
2019-11-20 08:23:15.293422: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593df00 of size 256
2019-11-20 08:23:15.293426: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593e000 of size 256
2019-11-20 08:23:15.293430: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593e100 of size 256
2019-11-20 08:23:15.293434: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593e200 of size 256
2019-11-20 08:23:15.293438: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593e300 of size 256
2019-11-20 08:23:15.293443: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593e400 of size 256
2019-11-20 08:23:15.293447: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593e500 of size 256
2019-11-20 08:23:15.293451: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593e600 of size 256
2019-11-20 08:23:15.293455: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593e700 of size 256
2019-11-20 08:23:15.293459: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593e800 of size 256
2019-11-20 08:23:15.293463: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593e900 of size 256
2019-11-20 08:23:15.293468: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65593ea00 of size 7680
2019-11-20 08:23:15.293472: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd655940800 of size 26112
2019-11-20 08:23:15.293477: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd655946e00 of size 98048
2019-11-20 08:23:15.293481: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65595ed00 of size 391680
2019-11-20 08:23:15.293485: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6559be700 of size 1566720
2019-11-20 08:23:15.293489: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd655b3cf00 of size 6220800
2019-11-20 08:23:15.293494: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65612bb00 of size 256
2019-11-20 08:23:15.293498: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65612bc00 of size 256
2019-11-20 08:23:15.293502: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65612bd00 of size 256
2019-11-20 08:23:15.293506: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65612be00 of size 256
2019-11-20 08:23:15.293510: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65612bf00 of size 256
2019-11-20 08:23:15.293515: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd65612c000 of size 256
2019-11-20 08:23:15.293519: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Free at 0x7fd65612c100 of size 468532992
2019-11-20 08:23:15.293524: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd690000000 of size 2359296
2019-11-20 08:23:15.293528: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd690240000 of size 2359296
2019-11-20 08:23:15.293532: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd690480000 of size 2359296
2019-11-20 08:23:15.293536: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6906c0000 of size 2359296
2019-11-20 08:23:15.293541: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd690900000 of size 2359296
2019-11-20 08:23:15.293545: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd690b40000 of size 2359296
2019-11-20 08:23:15.293549: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd690d80000 of size 1024
2019-11-20 08:23:15.293554: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd690d80400 of size 1024
2019-11-20 08:23:15.293558: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd690d80800 of size 1024
2019-11-20 08:23:15.293562: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd690d80c00 of size 1024
2019-11-20 08:23:15.293579: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd690d81000 of size 1024
2019-11-20 08:23:15.293583: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd690d81400 of size 1024
2019-11-20 08:23:15.293587: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd690d81800 of size 1024
2019-11-20 08:23:15.293591: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd690d81c00 of size 1024
2019-11-20 08:23:15.293595: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd690d82000 of size 1179648
2019-11-20 08:23:15.293599: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd690ea2000 of size 1179648
2019-11-20 08:23:15.293603: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd690fc2000 of size 1179648
2019-11-20 08:23:15.293607: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6910e2000 of size 1179648
2019-11-20 08:23:15.293611: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691202000 of size 1179648
2019-11-20 08:23:15.293615: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691322000 of size 1179648
2019-11-20 08:23:15.293619: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691442000 of size 1179648
2019-11-20 08:23:15.293623: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691562000 of size 1179648
2019-11-20 08:23:15.293627: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691682000 of size 1179648
2019-11-20 08:23:15.293631: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6917a2000 of size 1179648
2019-11-20 08:23:15.293635: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6918c2000 of size 1179648
2019-11-20 08:23:15.293639: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6919e2000 of size 1179648
2019-11-20 08:23:15.293643: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691b02000 of size 1179648
2019-11-20 08:23:15.293646: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c22000 of size 1024
2019-11-20 08:23:15.293651: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c22400 of size 1024
2019-11-20 08:23:15.293655: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c22800 of size 1024
2019-11-20 08:23:15.293659: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c22c00 of size 1024
2019-11-20 08:23:15.293662: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c23000 of size 1024
2019-11-20 08:23:15.293666: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c23400 of size 1024
2019-11-20 08:23:15.293670: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c23800 of size 1024
2019-11-20 08:23:15.293674: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c23c00 of size 1024
2019-11-20 08:23:15.293678: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c24000 of size 1024
2019-11-20 08:23:15.293682: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c24400 of size 1024
2019-11-20 08:23:15.293688: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c24800 of size 1024
2019-11-20 08:23:15.293692: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c24c00 of size 1024
2019-11-20 08:23:15.293696: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c25000 of size 1024
2019-11-20 08:23:15.293700: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c25400 of size 1024
2019-11-20 08:23:15.293704: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c25800 of size 1024
2019-11-20 08:23:15.293708: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c25c00 of size 1024
2019-11-20 08:23:15.293712: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c26000 of size 1024
2019-11-20 08:23:15.293716: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c26400 of size 1024
2019-11-20 08:23:15.293720: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c26800 of size 1024
2019-11-20 08:23:15.293724: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c26c00 of size 1024
2019-11-20 08:23:15.293728: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c27000 of size 1024
2019-11-20 08:23:15.293732: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c27400 of size 1024
2019-11-20 08:23:15.293736: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c27800 of size 1024
2019-11-20 08:23:15.293740: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c27c00 of size 1024
2019-11-20 08:23:15.293744: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c28000 of size 1024
2019-11-20 08:23:15.293748: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c28400 of size 1024
2019-11-20 08:23:15.293752: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c28800 of size 1024
2019-11-20 08:23:15.293756: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c28c00 of size 1024
2019-11-20 08:23:15.293760: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c29000 of size 1024
2019-11-20 08:23:15.293764: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c29400 of size 1024
2019-11-20 08:23:15.293767: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c29800 of size 1024
2019-11-20 08:23:15.293771: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c29c00 of size 1024
2019-11-20 08:23:15.293775: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2a000 of size 1024
2019-11-20 08:23:15.293779: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2a400 of size 1024
2019-11-20 08:23:15.293783: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2a800 of size 1024
2019-11-20 08:23:15.293787: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2ac00 of size 1024
2019-11-20 08:23:15.293791: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2b000 of size 1024
2019-11-20 08:23:15.293796: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2b400 of size 1024
2019-11-20 08:23:15.293800: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2b800 of size 1024
2019-11-20 08:23:15.293804: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2bc00 of size 1024
2019-11-20 08:23:15.293808: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2c000 of size 1024
2019-11-20 08:23:15.293812: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2c400 of size 1024
2019-11-20 08:23:15.293817: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2c800 of size 1024
2019-11-20 08:23:15.293821: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2cc00 of size 1024
2019-11-20 08:23:15.293826: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2d000 of size 1024
2019-11-20 08:23:15.293830: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2d400 of size 1024
2019-11-20 08:23:15.293834: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2d800 of size 1024
2019-11-20 08:23:15.293838: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2dc00 of size 1024
2019-11-20 08:23:15.293842: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2e000 of size 1024
2019-11-20 08:23:15.293847: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2e400 of size 1024
2019-11-20 08:23:15.293851: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2e800 of size 1024
2019-11-20 08:23:15.293855: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2ec00 of size 1024
2019-11-20 08:23:15.293859: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c2f000 of size 65536
2019-11-20 08:23:15.293863: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c3f000 of size 65536
2019-11-20 08:23:15.293867: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c4f000 of size 65536
2019-11-20 08:23:15.293871: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c5f000 of size 65536
2019-11-20 08:23:15.293875: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c6f000 of size 512
2019-11-20 08:23:15.293879: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c6f200 of size 512
2019-11-20 08:23:15.293883: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c6f400 of size 512
2019-11-20 08:23:15.293887: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c6f600 of size 512
2019-11-20 08:23:15.293892: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691c6f800 of size 589824
2019-11-20 08:23:15.293896: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691cff800 of size 589824
2019-11-20 08:23:15.293900: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691d8f800 of size 589824
2019-11-20 08:23:15.293904: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691e1f800 of size 589824
2019-11-20 08:23:15.293907: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691eaf800 of size 589824
2019-11-20 08:23:15.293911: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691f3f800 of size 589824
2019-11-20 08:23:15.293915: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd691fcf800 of size 589824
2019-11-20 08:23:15.293919: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69205f800 of size 589824
2019-11-20 08:23:15.293923: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6920ef800 of size 589824
2019-11-20 08:23:15.293927: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69217f800 of size 589824
2019-11-20 08:23:15.293931: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69220f800 of size 589824
2019-11-20 08:23:15.293935: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69229f800 of size 589824
2019-11-20 08:23:15.293939: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69232f800 of size 512
2019-11-20 08:23:15.293943: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69232fa00 of size 512
2019-11-20 08:23:15.293947: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69232fc00 of size 512
2019-11-20 08:23:15.293951: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69232fe00 of size 512
2019-11-20 08:23:15.293955: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692330000 of size 512
2019-11-20 08:23:15.293960: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692330200 of size 512
2019-11-20 08:23:15.293964: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692330400 of size 512
2019-11-20 08:23:15.293968: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692330600 of size 512
2019-11-20 08:23:15.293972: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692330800 of size 512
2019-11-20 08:23:15.293976: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692330a00 of size 512
2019-11-20 08:23:15.293980: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692330c00 of size 512
2019-11-20 08:23:15.293984: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692330e00 of size 512
2019-11-20 08:23:15.293988: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692331000 of size 512
2019-11-20 08:23:15.293992: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692331200 of size 512
2019-11-20 08:23:15.293996: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692331400 of size 512
2019-11-20 08:23:15.294000: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692331600 of size 512
2019-11-20 08:23:15.294004: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692331800 of size 512
2019-11-20 08:23:15.294008: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692331a00 of size 512
2019-11-20 08:23:15.294012: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692331c00 of size 512
2019-11-20 08:23:15.294016: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692331e00 of size 512
2019-11-20 08:23:15.294020: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692332000 of size 512
2019-11-20 08:23:15.294024: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692332200 of size 512
2019-11-20 08:23:15.294028: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692332400 of size 512
2019-11-20 08:23:15.294032: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692332600 of size 512
2019-11-20 08:23:15.294036: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692332800 of size 512
2019-11-20 08:23:15.294040: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692332a00 of size 512
2019-11-20 08:23:15.294044: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692332c00 of size 512
2019-11-20 08:23:15.294048: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692332e00 of size 512
2019-11-20 08:23:15.294052: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692333000 of size 512
2019-11-20 08:23:15.294056: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692333200 of size 512
2019-11-20 08:23:15.294061: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692333400 of size 512
2019-11-20 08:23:15.294065: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692333600 of size 512
2019-11-20 08:23:15.294069: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692333800 of size 512
2019-11-20 08:23:15.294073: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692333a00 of size 512
2019-11-20 08:23:15.294077: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692333c00 of size 512
2019-11-20 08:23:15.294081: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692333e00 of size 512
2019-11-20 08:23:15.294085: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692334000 of size 512
2019-11-20 08:23:15.294089: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692334200 of size 512
2019-11-20 08:23:15.294093: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692334400 of size 512
2019-11-20 08:23:15.294097: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692334600 of size 512
2019-11-20 08:23:15.294102: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692334800 of size 512
2019-11-20 08:23:15.294106: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692334a00 of size 512
2019-11-20 08:23:15.294110: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692334c00 of size 512
2019-11-20 08:23:15.294113: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692334e00 of size 512
2019-11-20 08:23:15.294117: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692335000 of size 512
2019-11-20 08:23:15.294121: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692335200 of size 512
2019-11-20 08:23:15.294125: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692335400 of size 512
2019-11-20 08:23:15.294129: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692335600 of size 512
2019-11-20 08:23:15.294133: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692335800 of size 512
2019-11-20 08:23:15.294137: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692335a00 of size 512
2019-11-20 08:23:15.294141: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692335c00 of size 512
2019-11-20 08:23:15.294145: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692335e00 of size 512
2019-11-20 08:23:15.294149: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692336000 of size 512
2019-11-20 08:23:15.294153: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692336200 of size 512
2019-11-20 08:23:15.294157: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692336400 of size 512
2019-11-20 08:23:15.294161: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692336600 of size 512
2019-11-20 08:23:15.294165: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692336800 of size 32768
2019-11-20 08:23:15.294169: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69233e800 of size 32768
2019-11-20 08:23:15.294173: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692346800 of size 32768
2019-11-20 08:23:15.294177: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69234e800 of size 32768
2019-11-20 08:23:15.294181: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692356800 of size 512
2019-11-20 08:23:15.294185: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692356a00 of size 512
2019-11-20 08:23:15.294189: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692356c00 of size 512
2019-11-20 08:23:15.294193: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692356e00 of size 512
2019-11-20 08:23:15.294197: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692357000 of size 512
2019-11-20 08:23:15.294201: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692357200 of size 512
2019-11-20 08:23:15.294205: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692357400 of size 512
2019-11-20 08:23:15.294209: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692357600 of size 512
2019-11-20 08:23:15.294213: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692357800 of size 294912
2019-11-20 08:23:15.294217: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69239f800 of size 294912
2019-11-20 08:23:15.294221: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6923e7800 of size 294912
2019-11-20 08:23:15.294225: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69242f800 of size 294912
2019-11-20 08:23:15.294229: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692477800 of size 512
2019-11-20 08:23:15.294234: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692477a00 of size 512
2019-11-20 08:23:15.294238: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692477c00 of size 512
2019-11-20 08:23:15.294242: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692477e00 of size 512
2019-11-20 08:23:15.294246: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692478000 of size 512
2019-11-20 08:23:15.294250: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692478200 of size 512
2019-11-20 08:23:15.294254: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692478400 of size 512
2019-11-20 08:23:15.294258: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692478600 of size 512
2019-11-20 08:23:15.294262: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692478800 of size 512
2019-11-20 08:23:15.294266: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692478a00 of size 512
2019-11-20 08:23:15.294270: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692478c00 of size 512
2019-11-20 08:23:15.294274: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692478e00 of size 512
2019-11-20 08:23:15.294278: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692479000 of size 512
2019-11-20 08:23:15.294282: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692479200 of size 512
2019-11-20 08:23:15.294286: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692479400 of size 512
2019-11-20 08:23:15.294290: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692479600 of size 512
2019-11-20 08:23:15.294294: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692479800 of size 512
2019-11-20 08:23:15.294298: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692479a00 of size 512
2019-11-20 08:23:15.294302: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692479c00 of size 512
2019-11-20 08:23:15.294306: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692479e00 of size 512
2019-11-20 08:23:15.294310: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247a000 of size 512
2019-11-20 08:23:15.294314: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247a200 of size 512
2019-11-20 08:23:15.294318: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247a400 of size 512
2019-11-20 08:23:15.294322: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247a600 of size 512
2019-11-20 08:23:15.294326: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247a800 of size 512
2019-11-20 08:23:15.294330: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247aa00 of size 512
2019-11-20 08:23:15.294334: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247ac00 of size 512
2019-11-20 08:23:15.294338: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247ae00 of size 512
2019-11-20 08:23:15.294342: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247b000 of size 512
2019-11-20 08:23:15.294346: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247b200 of size 512
2019-11-20 08:23:15.294350: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247b400 of size 512
2019-11-20 08:23:15.294354: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247b600 of size 512
2019-11-20 08:23:15.294358: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247b800 of size 512
2019-11-20 08:23:15.294362: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247ba00 of size 512
2019-11-20 08:23:15.294366: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247bc00 of size 512
2019-11-20 08:23:15.294370: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247be00 of size 512
2019-11-20 08:23:15.294375: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247c000 of size 512
2019-11-20 08:23:15.294379: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247c200 of size 512
2019-11-20 08:23:15.294383: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247c400 of size 512
2019-11-20 08:23:15.294386: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247c600 of size 512
2019-11-20 08:23:15.294390: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247c800 of size 512
2019-11-20 08:23:15.294394: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247ca00 of size 512
2019-11-20 08:23:15.294398: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247cc00 of size 512
2019-11-20 08:23:15.294402: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247ce00 of size 512
2019-11-20 08:23:15.294406: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247d000 of size 512
2019-11-20 08:23:15.294410: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247d200 of size 512
2019-11-20 08:23:15.294415: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247d400 of size 512
2019-11-20 08:23:15.294419: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247d600 of size 512
2019-11-20 08:23:15.294423: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247d800 of size 512
2019-11-20 08:23:15.294427: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247da00 of size 512
2019-11-20 08:23:15.294431: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247dc00 of size 512
2019-11-20 08:23:15.294435: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247de00 of size 512
2019-11-20 08:23:15.294439: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69247e000 of size 16384
2019-11-20 08:23:15.294443: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692482000 of size 16384
2019-11-20 08:23:15.294447: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692486000 of size 16384
2019-11-20 08:23:15.294466: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69248a000 of size 16384
2019-11-20 08:23:15.294470: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69248e000 of size 16384
2019-11-20 08:23:15.294475: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692492000 of size 16384
2019-11-20 08:23:15.294479: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692496000 of size 16384
2019-11-20 08:23:15.294483: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69249a000 of size 16384
2019-11-20 08:23:15.294488: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69249e000 of size 256
2019-11-20 08:23:15.294492: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69249e100 of size 256
2019-11-20 08:23:15.294496: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69249e200 of size 256
2019-11-20 08:23:15.294500: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69249e300 of size 256
2019-11-20 08:23:15.294505: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69249e400 of size 147456
2019-11-20 08:23:15.294509: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6924c2400 of size 147456
2019-11-20 08:23:15.294526: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6924e6400 of size 147456
2019-11-20 08:23:15.294530: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69250a400 of size 147456
2019-11-20 08:23:15.294550: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69252e400 of size 147456
2019-11-20 08:23:15.294555: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692552400 of size 147456
2019-11-20 08:23:15.294559: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692576400 of size 147456
2019-11-20 08:23:15.294563: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69259a400 of size 147456
2019-11-20 08:23:15.294567: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6925be400 of size 147456
2019-11-20 08:23:15.294572: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6925e2400 of size 147456
2019-11-20 08:23:15.294576: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692606400 of size 147456
2019-11-20 08:23:15.294593: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69262a400 of size 147456
2019-11-20 08:23:15.294597: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69264e400 of size 147456
2019-11-20 08:23:15.294619: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692672400 of size 147456
2019-11-20 08:23:15.294623: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692696400 of size 147456
2019-11-20 08:23:15.294627: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926ba400 of size 147456
2019-11-20 08:23:15.294631: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926de400 of size 256
2019-11-20 08:23:15.294635: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926de500 of size 256
2019-11-20 08:23:15.294639: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926de600 of size 256
2019-11-20 08:23:15.294644: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926de700 of size 256
2019-11-20 08:23:15.294661: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926de800 of size 256
2019-11-20 08:23:15.294665: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926de900 of size 256
2019-11-20 08:23:15.294684: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926dea00 of size 256
2019-11-20 08:23:15.294688: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926deb00 of size 256
2019-11-20 08:23:15.294692: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926dec00 of size 256
2019-11-20 08:23:15.294697: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926ded00 of size 256
2019-11-20 08:23:15.294701: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926dee00 of size 256
2019-11-20 08:23:15.294717: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926def00 of size 256
2019-11-20 08:23:15.294721: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926df000 of size 256
2019-11-20 08:23:15.294725: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926df100 of size 256
2019-11-20 08:23:15.294729: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926df200 of size 256
2019-11-20 08:23:15.294733: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926df300 of size 256
2019-11-20 08:23:15.294737: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926df400 of size 256
2019-11-20 08:23:15.294742: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926df500 of size 256
2019-11-20 08:23:15.294746: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926df600 of size 256
2019-11-20 08:23:15.294750: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926df700 of size 256
2019-11-20 08:23:15.294754: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926df800 of size 256
2019-11-20 08:23:15.294758: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926df900 of size 256
2019-11-20 08:23:15.294762: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926dfa00 of size 256
2019-11-20 08:23:15.294766: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926dfb00 of size 256
2019-11-20 08:23:15.294770: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926dfc00 of size 256
2019-11-20 08:23:15.294774: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926dfd00 of size 256
2019-11-20 08:23:15.294778: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926dfe00 of size 256
2019-11-20 08:23:15.294783: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926dff00 of size 256
2019-11-20 08:23:15.294787: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e0000 of size 256
2019-11-20 08:23:15.294791: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e0100 of size 256
2019-11-20 08:23:15.294795: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e0200 of size 256
2019-11-20 08:23:15.294799: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e0300 of size 256
2019-11-20 08:23:15.294803: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e0400 of size 256
2019-11-20 08:23:15.294807: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e0500 of size 256
2019-11-20 08:23:15.294811: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e0600 of size 256
2019-11-20 08:23:15.294815: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e0700 of size 256
2019-11-20 08:23:15.294819: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e0800 of size 256
2019-11-20 08:23:15.294823: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e0900 of size 256
2019-11-20 08:23:15.294827: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e0a00 of size 256
2019-11-20 08:23:15.294831: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e0b00 of size 256
2019-11-20 08:23:15.294835: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e0c00 of size 256
2019-11-20 08:23:15.294839: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e0d00 of size 256
2019-11-20 08:23:15.294843: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e0e00 of size 256
2019-11-20 08:23:15.294847: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e0f00 of size 256
2019-11-20 08:23:15.294851: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e1000 of size 256
2019-11-20 08:23:15.294855: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e1100 of size 256
2019-11-20 08:23:15.294860: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e1200 of size 256
2019-11-20 08:23:15.294864: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e1300 of size 256
2019-11-20 08:23:15.294867: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e1400 of size 256
2019-11-20 08:23:15.294871: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e1500 of size 256
2019-11-20 08:23:15.294875: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e1600 of size 256
2019-11-20 08:23:15.294879: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e1700 of size 256
2019-11-20 08:23:15.294883: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e1800 of size 256
2019-11-20 08:23:15.294887: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e1900 of size 256
2019-11-20 08:23:15.294891: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e1a00 of size 256
2019-11-20 08:23:15.294895: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e1b00 of size 256
2019-11-20 08:23:15.294899: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e1c00 of size 256
2019-11-20 08:23:15.294904: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e1d00 of size 256
2019-11-20 08:23:15.294908: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e1e00 of size 256
2019-11-20 08:23:15.294912: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e1f00 of size 256
2019-11-20 08:23:15.294916: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e2000 of size 256
2019-11-20 08:23:15.294920: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e2100 of size 256
2019-11-20 08:23:15.294924: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e2200 of size 256
2019-11-20 08:23:15.294928: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e2300 of size 256
2019-11-20 08:23:15.294932: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e2400 of size 256
2019-11-20 08:23:15.294936: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e2500 of size 256
2019-11-20 08:23:15.294940: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e2600 of size 256
2019-11-20 08:23:15.294944: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e2700 of size 256
2019-11-20 08:23:15.294948: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e2800 of size 256
2019-11-20 08:23:15.294952: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e2900 of size 256
2019-11-20 08:23:15.294956: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e2a00 of size 256
2019-11-20 08:23:15.294960: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e2b00 of size 256
2019-11-20 08:23:15.294964: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e2c00 of size 256
2019-11-20 08:23:15.294968: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e2d00 of size 256
2019-11-20 08:23:15.294972: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e2e00 of size 256
2019-11-20 08:23:15.294976: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e2f00 of size 256
2019-11-20 08:23:15.294980: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e3000 of size 256
2019-11-20 08:23:15.294984: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e3100 of size 256
2019-11-20 08:23:15.294988: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e3200 of size 256
2019-11-20 08:23:15.294992: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e3300 of size 256
2019-11-20 08:23:15.294996: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e3400 of size 256
2019-11-20 08:23:15.295001: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e3500 of size 256
2019-11-20 08:23:15.295005: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e3600 of size 256
2019-11-20 08:23:15.295009: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e3700 of size 256
2019-11-20 08:23:15.295013: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e3800 of size 256
2019-11-20 08:23:15.295017: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e3900 of size 256
2019-11-20 08:23:15.295021: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e3a00 of size 256
2019-11-20 08:23:15.295025: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e3b00 of size 256
2019-11-20 08:23:15.295029: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e3c00 of size 256
2019-11-20 08:23:15.295033: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e3d00 of size 256
2019-11-20 08:23:15.295037: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e3e00 of size 256
2019-11-20 08:23:15.295041: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e3f00 of size 256
2019-11-20 08:23:15.295045: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e4000 of size 256
2019-11-20 08:23:15.295049: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e4100 of size 256
2019-11-20 08:23:15.295053: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e4200 of size 256
2019-11-20 08:23:15.295057: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e4300 of size 256
2019-11-20 08:23:15.295061: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e4400 of size 256
2019-11-20 08:23:15.295065: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e4500 of size 256
2019-11-20 08:23:15.295069: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e4600 of size 256
2019-11-20 08:23:15.295073: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e4700 of size 256
2019-11-20 08:23:15.295077: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e4800 of size 256
2019-11-20 08:23:15.295081: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e4900 of size 256
2019-11-20 08:23:15.295085: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e4a00 of size 256
2019-11-20 08:23:15.295089: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e4b00 of size 256
2019-11-20 08:23:15.295093: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e4c00 of size 256
2019-11-20 08:23:15.295097: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e4d00 of size 256
2019-11-20 08:23:15.295101: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e4e00 of size 256
2019-11-20 08:23:15.295105: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e4f00 of size 256
2019-11-20 08:23:15.295109: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e5000 of size 256
2019-11-20 08:23:15.295113: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk

2019-11-20 08:23:15.295137: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e5700 of size 256
2019-11-20 08:23:15.295141: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e5800 of size 1024
2019-11-20 08:23:15.295146: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e5c00 of size 1024
2019-11-20 08:23:15.295150: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e6000 of size 1024
2019-11-20 08:23:15.295154: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6926e6400 of size 131072
2019-11-20 08:23:15.295158: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692706400 of size 131072
2019-11-20 08:23:15.295162: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692726400 of size 131072
2019-11-20 08:23:15.295166: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692746400 of size 131072
2019-11-20 08:23:15.295170: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692766400 of size 131072
2019-11-20 08:23:15.295174: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692786400 of size 131072
2019-11-20 08:23:15.295178: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6927a6400 of size 512
2019-11-20 08:23:15.295182: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6927a6600 of size 512
2019-11-20 08:23:15.295186: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6927a6800 of size 512
2019-11-20 08:23:15.295190: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6927a6a00 of size 1024
2019-11-20 08:23:15.295194: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6927a6e00 of size 1024
2019-11-20 08:23:15.295198: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6927a7200 of size 1024
2019-11-20 08:23:15.295203: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6927a7600 of size 512
2019-11-20 08:23:15.295207: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6927a7800 of size 512
2019-11-20 08:23:15.295211: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6927a7a00 of size 512
2019-11-20 08:23:15.295215: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6927a7c00 of size 1024
2019-11-20 08:23:15.295219: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6927a8000 of size 1024
2019-11-20 08:23:15.295223: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6927a8400 of size 1024
2019-11-20 08:23:15.295227: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6927a8800 of size 262144
2019-11-20 08:23:15.295231: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6927e8800 of size 262144
2019-11-20 08:23:15.295235: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692828800 of size 262144
2019-11-20 08:23:15.295240: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692868800 of size 512
2019-11-20 08:23:15.295244: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692868a00 of size 512
2019-11-20 08:23:15.295248: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692868c00 of size 512
2019-11-20 08:23:15.295252: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692868e00 of size 2048
2019-11-20 08:23:15.295256: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692869600 of size 2048
2019-11-20 08:23:15.295260: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692869e00 of size 2048
2019-11-20 08:23:15.295264: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69286a600 of size 1048576
2019-11-20 08:23:15.295268: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69296a600 of size 1048576
2019-11-20 08:23:15.295272: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692a6a600 of size 1048576
2019-11-20 08:23:15.295276: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692b6a600 of size 1024
2019-11-20 08:23:15.295280: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692b6aa00 of size 1024
2019-11-20 08:23:15.295284: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692b6ae00 of size 1024
2019-11-20 08:23:15.295288: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692b6b200 of size 256
2019-11-20 08:23:15.295292: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692b6b300 of size 256
2019-11-20 08:23:15.295297: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692b6b400 of size 256
2019-11-20 08:23:15.295301: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692b6b500 of size 256
2019-11-20 08:23:15.295305: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692b6b600 of size 2048
2019-11-20 08:23:15.295309: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692b6be00 of size 1048576
2019-11-20 08:23:15.295313: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd692c6be00 of size 9437184
2019-11-20 08:23:15.295317: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69356be00 of size 256
2019-11-20 08:23:15.295321: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69356bf00 of size 524288
2019-11-20 08:23:15.295326: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6935ebf00 of size 147456
2019-11-20 08:23:15.295330: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69360ff00 of size 4718592
2019-11-20 08:23:15.295334: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd693a8ff00 of size 1024
2019-11-20 08:23:15.295338: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd693a90300 of size 262144
2019-11-20 08:23:15.295342: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd693ad0300 of size 2359296
2019-11-20 08:23:15.295346: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd693d10300 of size 131072
2019-11-20 08:23:15.295350: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd693d30300 of size 1179648
2019-11-20 08:23:15.295354: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd693e50300 of size 512
2019-11-20 08:23:15.295358: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd693e50500 of size 65536
2019-11-20 08:23:15.295363: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd693e60500 of size 589824
2019-11-20 08:23:15.295367: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd693ef0500 of size 32768
2019-11-20 08:23:15.295371: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd693ef8500 of size 294912
2019-11-20 08:23:15.295375: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd693f40500 of size 16384
2019-11-20 08:23:15.295379: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd693f44500 of size 768
2019-11-20 08:23:15.295383: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd693f44800 of size 360448
2019-11-20 08:23:15.295387: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd693f9c800 of size 37632
2019-11-20 08:23:15.295391: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd693fa5b00 of size 256
2019-11-20 08:23:15.295395: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd693fa5c00 of size 256
2019-11-20 08:23:15.295399: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd693fa5d00 of size 256
2019-11-20 08:23:15.295403: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd693fa5e00 of size 256
2019-11-20 08:23:15.295407: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd693fa5f00 of size 2048
2019-11-20 08:23:15.295412: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd693fa6700 of size 2048
2019-11-20 08:23:15.295416: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd693fa6f00 of size 2048
2019-11-20 08:23:15.295420: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd693fa7700 of size 2048
2019-11-20 08:23:15.295424: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd693fa7f00 of size 2048
2019-11-20 08:23:15.295428: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd693fa8700 of size 1048576
2019-11-20 08:23:15.295432: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6940a8700 of size 2048
2019-11-20 08:23:15.295436: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6940a8f00 of size 9437184
2019-11-20 08:23:15.295440: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6949a8f00 of size 2048
2019-11-20 08:23:15.295444: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6949a9700 of size 2048
2019-11-20 08:23:15.295448: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6949a9f00 of size 256
2019-11-20 08:23:15.295453: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6949aa000 of size 2048
2019-11-20 08:23:15.295457: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6949aa800 of size 9437184
2019-11-20 08:23:15.295461: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6952aa800 of size 2048
2019-11-20 08:23:15.295465: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6952ab000 of size 2048
2019-11-20 08:23:15.295469: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6952ab800 of size 2048
2019-11-20 08:23:15.295473: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6952ac000 of size 2048
2019-11-20 08:23:15.295477: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6952ac800 of size 2048
2019-11-20 08:23:15.295481: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6952ad000 of size 524288
2019-11-20 08:23:15.295485: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69532d000 of size 2048
2019-11-20 08:23:15.295489: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69532d800 of size 9437184
2019-11-20 08:23:15.295493: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd695c2d800 of size 147456
2019-11-20 08:23:15.295497: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd695c51800 of size 2048
2019-11-20 08:23:15.295501: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd695c52000 of size 2048
2019-11-20 08:23:15.295505: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd695c52800 of size 2048
2019-11-20 08:23:15.295509: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd695c53000 of size 4718592
2019-11-20 08:23:15.295514: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6960d3000 of size 1024
2019-11-20 08:23:15.295518: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6960d3400 of size 1024
2019-11-20 08:23:15.295522: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6960d3800 of size 1024
2019-11-20 08:23:15.295526: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6960d3c00 of size 1024
2019-11-20 08:23:15.295530: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6960d4000 of size 1024
2019-11-20 08:23:15.295534: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6960d4400 of size 262144
2019-11-20 08:23:15.295538: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696114400 of size 256
2019-11-20 08:23:15.295542: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696114500 of size 1024
2019-11-20 08:23:15.295546: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696114900 of size 2359296
2019-11-20 08:23:15.295550: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696354900 of size 1024
2019-11-20 08:23:15.295554: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696354d00 of size 1024
2019-11-20 08:23:15.295558: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696355100 of size 1024
2019-11-20 08:23:15.295562: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696355500 of size 2359296
2019-11-20 08:23:15.295566: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696595500 of size 1024
2019-11-20 08:23:15.295570: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696595900 of size 1024
2019-11-20 08:23:15.295574: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696595d00 of size 1024
2019-11-20 08:23:15.295578: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696596100 of size 1024
2019-11-20 08:23:15.295582: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696596500 of size 256
2019-11-20 08:23:15.295587: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696596600 of size 1024
2019-11-20 08:23:15.295591: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696596a00 of size 131072
2019-11-20 08:23:15.295595: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6965b6a00 of size 1024
2019-11-20 08:23:15.295599: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6965b6e00 of size 2359296
2019-11-20 08:23:15.295603: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6967f6e00 of size 1024
2019-11-20 08:23:15.295607: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6967f7200 of size 1024
2019-11-20 08:23:15.295611: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6967f7600 of size 1024
2019-11-20 08:23:15.295615: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6967f7a00 of size 1179648
2019-11-20 08:23:15.295619: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696917a00 of size 512
2019-11-20 08:23:15.295647: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696917c00 of size 512
2019-11-20 08:23:15.295652: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696917e00 of size 256
2019-11-20 08:23:15.295656: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696917f00 of size 512
2019-11-20 08:23:15.295660: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696918100 of size 512
2019-11-20 08:23:15.295665: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696918300 of size 512
2019-11-20 08:23:15.295669: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696918500 of size 65536
2019-11-20 08:23:15.295686: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696928500 of size 512
2019-11-20 08:23:15.295690: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696928700 of size 589824
2019-11-20 08:23:15.295694: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6969b8700 of size 512
2019-11-20 08:23:15.295698: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6969b8900 of size 512
2019-11-20 08:23:15.295702: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6969b8b00 of size 512
2019-11-20 08:23:15.295706: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6969b8d00 of size 589824
2019-11-20 08:23:15.295710: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696a48d00 of size 147456
2019-11-20 08:23:15.295714: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696a6cd00 of size 512
2019-11-20 08:23:15.295718: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696a6cf00 of size 512
2019-11-20 08:23:15.295722: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696a6d100 of size 512
2019-11-20 08:23:15.295726: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696a6d300 of size 512
2019-11-20 08:23:15.295730: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696a6d500 of size 512
2019-11-20 08:23:15.295734: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696a6d700 of size 32768
2019-11-20 08:23:15.295738: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696a75700 of size 512
2019-11-20 08:23:15.295742: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696a75900 of size 589824
2019-11-20 08:23:15.295746: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696b05900 of size 512
2019-11-20 08:23:15.295750: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696b05b00 of size 512
2019-11-20 08:23:15.295754: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696b05d00 of size 256
2019-11-20 08:23:15.295758: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696b05e00 of size 512
2019-11-20 08:23:15.295778: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696b06000 of size 294912
2019-11-20 08:23:15.295783: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696b4e000 of size 256
2019-11-20 08:23:15.295787: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696b4e100 of size 256
2019-11-20 08:23:15.295791: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696b4e200 of size 256
2019-11-20 08:23:15.295795: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696b4e300 of size 256
2019-11-20 08:23:15.295800: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696b4e400 of size 256
2019-11-20 08:23:15.295804: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696b4e500 of size 16384
2019-11-20 08:23:15.295822: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696b52500 of size 256
2019-11-20 08:23:15.295826: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696b52600 of size 147456
2019-11-20 08:23:15.295845: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696b76600 of size 256
2019-11-20 08:23:15.295849: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696b76700 of size 256
2019-11-20 08:23:15.295853: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696b76800 of size 256
2019-11-20 08:23:15.295858: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696b76900 of size 256
2019-11-20 08:23:15.295862: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696b76a00 of size 147456
2019-11-20 08:23:15.295866: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696b9aa00 of size 256
2019-11-20 08:23:15.295870: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696b9ab00 of size 256
2019-11-20 08:23:15.295874: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696b9ac00 of size 256
2019-11-20 08:23:15.295878: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696b9ad00 of size 256
2019-11-20 08:23:15.295882: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696b9ae00 of size 256
2019-11-20 08:23:15.295887: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696b9af00 of size 768
2019-11-20 08:23:15.295891: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696b9b200 of size 360448
2019-11-20 08:23:15.295895: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696bf3200 of size 16384
2019-11-20 08:23:15.295899: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696bf7200 of size 256
2019-11-20 08:23:15.295904: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696bf7300 of size 37632
2019-11-20 08:23:15.295924: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696c00600 of size 256
2019-11-20 08:23:15.295928: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696c00700 of size 256
2019-11-20 08:23:15.295948: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696c00800 of size 256
2019-11-20 08:23:15.295952: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696c00900 of size 256
2019-11-20 08:23:15.295957: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696c00a00 of size 256
2019-11-20 08:23:15.295961: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696c00b00 of size 256
2019-11-20 08:23:15.295965: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696c00c00 of size 4096
2019-11-20 08:23:15.295969: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd696c01c00 of size 18874368
2019-11-20 08:23:15.295974: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd697e01c00 of size 2048
2019-11-20 08:23:15.295998: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd697e02400 of size 1048576
2019-11-20 08:23:15.296002: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd697f02400 of size 9437184
2019-11-20 08:23:15.296006: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd698802400 of size 256
2019-11-20 08:23:15.296010: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd698802500 of size 524288
2019-11-20 08:23:15.296014: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd698882500 of size 16384
2019-11-20 08:23:15.296019: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd698886500 of size 4718592
2019-11-20 08:23:15.296023: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd698d06500 of size 1024
2019-11-20 08:23:15.296027: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd698d06900 of size 262144
2019-11-20 08:23:15.296031: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd698d46900 of size 2359296
2019-11-20 08:23:15.296035: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd698f86900 of size 147456
2019-11-20 08:23:15.296039: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd698faa900 of size 131072
2019-11-20 08:23:15.296043: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd698fca900 of size 1179648
2019-11-20 08:23:15.296047: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6990ea900 of size 512
2019-11-20 08:23:15.296051: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6990eab00 of size 65536
2019-11-20 08:23:15.296055: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6990fab00 of size 589824
2019-11-20 08:23:15.296059: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69918ab00 of size 32768
2019-11-20 08:23:15.296063: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd699192b00 of size 294912
2019-11-20 08:23:15.296067: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6991dab00 of size 256
2019-11-20 08:23:15.296071: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6991dac00 of size 221184
2019-11-20 08:23:15.296075: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd699210c00 of size 442368
2019-11-20 08:23:15.296080: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69927cc00 of size 110592
2019-11-20 08:23:15.296083: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd699297c00 of size 256
2019-11-20 08:23:15.296088: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd699297d00 of size 165888
2019-11-20 08:23:15.296092: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6992c0500 of size 331776
2019-11-20 08:23:15.296096: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd699311500 of size 82944
2019-11-20 08:23:15.296100: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd699325900 of size 131072
2019-11-20 08:23:15.296104: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd699345900 of size 262144
2019-11-20 08:23:15.296108: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd699385900 of size 1048576
2019-11-20 08:23:15.296112: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd699485900 of size 4194304
2019-11-20 08:23:15.296116: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd699885900 of size 256
2019-11-20 08:23:15.296120: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd699885a00 of size 256
2019-11-20 08:23:15.296124: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd699885b00 of size 256
2019-11-20 08:23:15.296128: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd699885c00 of size 256
2019-11-20 08:23:15.296132: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd699885d00 of size 4096
2019-11-20 08:23:15.296137: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd699886d00 of size 18874368
2019-11-20 08:23:15.296141: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69aa86d00 of size 2048
2019-11-20 08:23:15.296145: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69aa87500 of size 2048
2019-11-20 08:23:15.296149: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69aa87d00 of size 2048
2019-11-20 08:23:15.296153: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69aa88500 of size 2048
2019-11-20 08:23:15.296157: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69aa88d00 of size 2048
2019-11-20 08:23:15.296161: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69aa89500 of size 1048576
2019-11-20 08:23:15.296165: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69ab89500 of size 2048
2019-11-20 08:23:15.296169: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69ab89d00 of size 9437184
2019-11-20 08:23:15.296173: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69b489d00 of size 256
2019-11-20 08:23:15.296178: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69b489e00 of size 2048
2019-11-20 08:23:15.296182: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69b48a600 of size 2048
2019-11-20 08:23:15.296186: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69b48ae00 of size 2048
2019-11-20 08:23:15.296190: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69b48b600 of size 9437184
2019-11-20 08:23:15.296194: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69bd8b600 of size 2048
2019-11-20 08:23:15.296198: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69bd8be00 of size 2048
2019-11-20 08:23:15.296202: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69bd8c600 of size 2048
2019-11-20 08:23:15.296206: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69bd8ce00 of size 2048
2019-11-20 08:23:15.296210: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69bd8d600 of size 2048
2019-11-20 08:23:15.296214: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69bd8de00 of size 524288
2019-11-20 08:23:15.296218: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69be0de00 of size 16384
2019-11-20 08:23:15.296222: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69be11e00 of size 2048
2019-11-20 08:23:15.296226: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69be12600 of size 9437184
2019-11-20 08:23:15.296230: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69c712600 of size 2048
2019-11-20 08:23:15.296234: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69c712e00 of size 2048
2019-11-20 08:23:15.296238: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69c713600 of size 2048
2019-11-20 08:23:15.296242: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69c713e00 of size 4718592
2019-11-20 08:23:15.296246: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69cb93e00 of size 1024
2019-11-20 08:23:15.296250: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69cb94200 of size 1024
2019-11-20 08:23:15.296254: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69cb94600 of size 1024
2019-11-20 08:23:15.296258: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69cb94a00 of size 1024
2019-11-20 08:23:15.296262: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69cb94e00 of size 256
2019-11-20 08:23:15.296266: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69cb94f00 of size 1024
2019-11-20 08:23:15.296271: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69cb95300 of size 262144
2019-11-20 08:23:15.296275: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69cbd5300 of size 1024
2019-11-20 08:23:15.296279: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69cbd5700 of size 2359296
2019-11-20 08:23:15.296283: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69ce15700 of size 1024
2019-11-20 08:23:15.296287: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69ce15b00 of size 1024
2019-11-20 08:23:15.296291: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69ce15f00 of size 1024
2019-11-20 08:23:15.296295: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69ce16300 of size 2359296
2019-11-20 08:23:15.296299: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d056300 of size 1024
2019-11-20 08:23:15.296303: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d056700 of size 1024
2019-11-20 08:23:15.296307: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d056b00 of size 147456
2019-11-20 08:23:15.296311: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d07ab00 of size 1024
2019-11-20 08:23:15.296315: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d07af00 of size 1024
2019-11-20 08:23:15.296319: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d07b300 of size 1024
2019-11-20 08:23:15.296323: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d07b700 of size 131072
2019-11-20 08:23:15.296327: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d09b700 of size 1024
2019-11-20 08:23:15.296331: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d09bb00 of size 2359296
2019-11-20 08:23:15.296335: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d2dbb00 of size 1024
2019-11-20 08:23:15.296339: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d2dbf00 of size 1024
2019-11-20 08:23:15.296343: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d2dc300 of size 1024
2019-11-20 08:23:15.296347: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d2dc700 of size 1179648
2019-11-20 08:23:15.296351: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d3fc700 of size 256
2019-11-20 08:23:15.296356: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d3fc800 of size 512
2019-11-20 08:23:15.296360: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d3fca00 of size 512
2019-11-20 08:23:15.296364: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d3fcc00 of size 512
2019-11-20 08:23:15.296368: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d3fce00 of size 512
2019-11-20 08:23:15.296372: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d3fd000 of size 512
2019-11-20 08:23:15.296376: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d3fd200 of size 65536
2019-11-20 08:23:15.296380: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d40d200 of size 512
2019-11-20 08:23:15.296384: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d40d400 of size 589824
2019-11-20 08:23:15.296388: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d49d400 of size 512
2019-11-20 08:23:15.296392: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d49d600 of size 512
2019-11-20 08:23:15.296396: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d49d800 of size 256
2019-11-20 08:23:15.296400: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d49d900 of size 512
2019-11-20 08:23:15.296404: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d49db00 of size 589824
2019-11-20 08:23:15.296409: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d52db00 of size 512
2019-11-20 08:23:15.296413: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d52dd00 of size 512
2019-11-20 08:23:15.296417: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d52df00 of size 512
2019-11-20 08:23:15.296421: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d52e100 of size 512
2019-11-20 08:23:15.296425: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d52e300 of size 512
2019-11-20 08:23:15.296429: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d52e500 of size 32768
2019-11-20 08:23:15.296433: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d536500 of size 512
2019-11-20 08:23:15.296437: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d536700 of size 589824
2019-11-20 08:23:15.296441: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d5c6700 of size 256
2019-11-20 08:23:15.296445: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d5c6800 of size 512
2019-11-20 08:23:15.296449: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d5c6a00 of size 512
2019-11-20 08:23:15.296453: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d5c6c00 of size 512
2019-11-20 08:23:15.296457: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d5c6e00 of size 294912
2019-11-20 08:23:15.296461: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d60ee00 of size 256
2019-11-20 08:23:15.296465: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d60ef00 of size 256
2019-11-20 08:23:15.296469: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d60f000 of size 256
2019-11-20 08:23:15.296473: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d60f100 of size 256
2019-11-20 08:23:15.296477: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d60f200 of size 256
2019-11-20 08:23:15.296482: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d60f300 of size 16384
2019-11-20 08:23:15.296486: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d613300 of size 147456
2019-11-20 08:23:15.296490: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d637300 of size 256
2019-11-20 08:23:15.296494: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d637400 of size 147456
2019-11-20 08:23:15.296498: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d65b400 of size 256
2019-11-20 08:23:15.296502: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d65b500 of size 256
2019-11-20 08:23:15.296506: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d65b600 of size 256
2019-11-20 08:23:15.296510: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d65b700 of size 256
2019-11-20 08:23:15.296514: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d65b800 of size 221184
2019-11-20 08:23:15.296518: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d691800 of size 147456
2019-11-20 08:23:15.296522: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d6b5800 of size 256
2019-11-20 08:23:15.296526: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d6b5900 of size 221184
2019-11-20 08:23:15.296530: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d6eb900 of size 256
2019-11-20 08:23:15.296534: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d6eba00 of size 221184
2019-11-20 08:23:15.296538: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d721a00 of size 256
2019-11-20 08:23:15.296542: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d721b00 of size 442368
2019-11-20 08:23:15.296546: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d78db00 of size 256
2019-11-20 08:23:15.296551: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d78dc00 of size 442368
2019-11-20 08:23:15.296555: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d7f9c00 of size 256
2019-11-20 08:23:15.296559: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d7f9d00 of size 110592
2019-11-20 08:23:15.296563: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d814d00 of size 256
2019-11-20 08:23:15.296567: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d814e00 of size 256
2019-11-20 08:23:15.296571: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d814f00 of size 165888
2019-11-20 08:23:15.296575: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d83d700 of size 256
2019-11-20 08:23:15.296579: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d83d800 of size 165888
2019-11-20 08:23:15.296583: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d866000 of size 256
2019-11-20 08:23:15.296587: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d866100 of size 165888
2019-11-20 08:23:15.296591: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d88e900 of size 256
2019-11-20 08:23:15.296595: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d88ea00 of size 331776
2019-11-20 08:23:15.296599: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d8dfa00 of size 256
2019-11-20 08:23:15.296603: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d8dfb00 of size 331776
2019-11-20 08:23:15.296607: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d930b00 of size 256
2019-11-20 08:23:15.296611: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d930c00 of size 256
2019-11-20 08:23:15.296615: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d930d00 of size 82944
2019-11-20 08:23:15.296619: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d945100 of size 1024
2019-11-20 08:23:15.296624: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69d945500 of size 1179648
2019-11-20 08:23:15.296628: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69da65500 of size 512
2019-11-20 08:23:15.296632: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69da65700 of size 131072
2019-11-20 08:23:15.296636: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69da85700 of size 1024
2019-11-20 08:23:15.296640: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69da85b00 of size 1179648
2019-11-20 08:23:15.296644: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69dba5b00 of size 512
2019-11-20 08:23:15.296648: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69dba5d00 of size 131072
2019-11-20 08:23:15.296652: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69dbc5d00 of size 256
2019-11-20 08:23:15.296656: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69dbc5e00 of size 1024
2019-11-20 08:23:15.296660: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69dbc6200 of size 1179648
2019-11-20 08:23:15.296664: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69dce6200 of size 512
2019-11-20 08:23:15.296668: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69dce6400 of size 262144
2019-11-20 08:23:15.296673: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69dd26400 of size 2048
2019-11-20 08:23:15.296677: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69dd26c00 of size 4718592
2019-11-20 08:23:15.298171: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e1a6c00 of size 1024
2019-11-20 08:23:15.298190: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e1a7000 of size 1048576
2019-11-20 08:23:15.298195: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e2a7000 of size 4096
2019-11-20 08:23:15.298199: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e2a8000 of size 4194304
2019-11-20 08:23:15.298204: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e6a8000 of size 256
2019-11-20 08:23:15.298208: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e6a8100 of size 256
2019-11-20 08:23:15.298212: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e6a8200 of size 256
2019-11-20 08:23:15.298216: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e6a8300 of size 256
2019-11-20 08:23:15.298220: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e6a8400 of size 256
2019-11-20 08:23:15.298224: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e6a8500 of size 256
2019-11-20 08:23:15.298228: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e6a8600 of size 256
2019-11-20 08:23:15.298232: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e6a8700 of size 524288
2019-11-20 08:23:15.298236: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e728700 of size 262144
2019-11-20 08:23:15.298240: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e768700 of size 2359296
2019-11-20 08:23:15.298245: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9a8700 of size 131072
2019-11-20 08:23:15.298249: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9c8700 of size 256
2019-11-20 08:23:15.298253: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9c8800 of size 256
2019-11-20 08:23:15.298257: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9c8900 of size 256
2019-11-20 08:23:15.298261: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9c8a00 of size 256
2019-11-20 08:23:15.298265: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9c8b00 of size 256
2019-11-20 08:23:15.298269: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9c8c00 of size 256
2019-11-20 08:23:15.298273: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9c8d00 of size 256
2019-11-20 08:23:15.298277: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9c8e00 of size 256
2019-11-20 08:23:15.298281: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9c8f00 of size 256
2019-11-20 08:23:15.298285: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9c9000 of size 256
2019-11-20 08:23:15.298289: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9c9100 of size 256
2019-11-20 08:23:15.298293: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9c9200 of size 256
2019-11-20 08:23:15.298297: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9c9300 of size 256
2019-11-20 08:23:15.298301: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9c9400 of size 256
2019-11-20 08:23:15.298305: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9c9500 of size 256
2019-11-20 08:23:15.298309: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9c9600 of size 256
2019-11-20 08:23:15.298313: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9c9700 of size 256
2019-11-20 08:23:15.298317: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9c9800 of size 256
2019-11-20 08:23:15.298321: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9c9900 of size 256
2019-11-20 08:23:15.298325: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9c9a00 of size 256
2019-11-20 08:23:15.298329: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9c9b00 of size 256
2019-11-20 08:23:15.298333: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9c9c00 of size 256
2019-11-20 08:23:15.298337: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9c9d00 of size 256
2019-11-20 08:23:15.298341: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9c9e00 of size 256
2019-11-20 08:23:15.298345: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9c9f00 of size 256
2019-11-20 08:23:15.298349: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9ca000 of size 256
2019-11-20 08:23:15.298354: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9ca100 of size 256
2019-11-20 08:23:15.298358: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9ca200 of size 256
2019-11-20 08:23:15.298362: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9ca300 of size 256
2019-11-20 08:23:15.298366: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9ca400 of size 256
2019-11-20 08:23:15.298370: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9ca500 of size 256
2019-11-20 08:23:15.298374: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9ca600 of size 256
2019-11-20 08:23:15.298378: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9ca700 of size 256
2019-11-20 08:23:15.298382: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9ca800 of size 256
2019-11-20 08:23:15.298386: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9ca900 of size 256
2019-11-20 08:23:15.298390: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9caa00 of size 256
2019-11-20 08:23:15.298394: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9cab00 of size 256
2019-11-20 08:23:15.298398: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9cac00 of size 256
2019-11-20 08:23:15.298402: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9cad00 of size 256
2019-11-20 08:23:15.298406: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9cae00 of size 256
2019-11-20 08:23:15.298410: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9caf00 of size 256
2019-11-20 08:23:15.298414: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9cb000 of size 256
2019-11-20 08:23:15.298418: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9cb100 of size 256
2019-11-20 08:23:15.298422: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9cb200 of size 256
2019-11-20 08:23:15.298426: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9cb300 of size 256
2019-11-20 08:23:15.298430: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9cb400 of size 256
2019-11-20 08:23:15.298433: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9cb500 of size 256
2019-11-20 08:23:15.298437: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9cb600 of size 256
2019-11-20 08:23:15.298441: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9cb700 of size 256
2019-11-20 08:23:15.298445: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9cb800 of size 256
2019-11-20 08:23:15.298449: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9cb900 of size 256
2019-11-20 08:23:15.298454: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9cba00 of size 256
2019-11-20 08:23:15.298458: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9cbb00 of size 256
2019-11-20 08:23:15.298463: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9cbc00 of size 256
2019-11-20 08:23:15.298468: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9cbd00 of size 256
2019-11-20 08:23:15.298472: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9cbe00 of size 256
2019-11-20 08:23:15.298476: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9cbf00 of size 256
2019-11-20 08:23:15.298480: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9cc000 of size 256
2019-11-20 08:23:15.298484: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9cc100 of size 256
2019-11-20 08:23:15.298489: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9cc200 of size 256
2019-11-20 08:23:15.298493: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9cc300 of size 256
2019-11-20 08:23:15.298497: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9cc400 of size 256
2019-11-20 08:23:15.298501: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9cc500 of size 256
2019-11-20 08:23:15.298505: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9cc600 of size 256
2019-11-20 08:23:15.298509: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9cc700 of size 256
2019-11-20 08:23:15.298513: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9cc800 of size 256
2019-11-20 08:23:15.298517: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9cc900 of size 256
2019-11-20 08:23:15.298521: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9cca00 of size 256
2019-11-20 08:23:15.298526: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9ccb00 of size 256
2019-11-20 08:23:15.298530: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9ccc00 of size 256
2019-11-20 08:23:15.298534: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9ccd00 of size 256
2019-11-20 08:23:15.298538: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9cce00 of size 256
2019-11-20 08:23:15.298542: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9ccf00 of size 256
2019-11-20 08:23:15.298547: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69e9cd000 of size 3116544
2019-11-20 08:23:15.298551: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69ecc5e00 of size 256
2019-11-20 08:23:15.298555: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd69ecc5f00 of size 20160768
2019-11-20 08:23:15.298560: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6a8000000 of size 9437184
2019-11-20 08:23:15.298564: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6a8900000 of size 9437184
2019-11-20 08:23:15.298568: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6a9200000 of size 9437184
2019-11-20 08:23:15.298572: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6a9b00000 of size 9437184
2019-11-20 08:23:15.298576: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6aa400000 of size 9437184
2019-11-20 08:23:15.298580: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6aad00000 of size 9437184
2019-11-20 08:23:15.298584: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6ab600000 of size 9437184
2019-11-20 08:23:15.298588: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6abf00000 of size 9437184
2019-11-20 08:23:15.298592: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6ac800000 of size 9437184
2019-11-20 08:23:15.298596: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6ad100000 of size 4718592
2019-11-20 08:23:15.298601: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6ad580000 of size 4718592
2019-11-20 08:23:15.298605: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6ada00000 of size 4718592
2019-11-20 08:23:15.298609: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6ade80000 of size 4718592
2019-11-20 08:23:15.298613: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6ae300000 of size 4718592
2019-11-20 08:23:15.298617: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6ae780000 of size 4718592
2019-11-20 08:23:15.298621: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6aec00000 of size 4718592
2019-11-20 08:23:15.298625: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6af080000 of size 2359296
2019-11-20 08:23:15.298630: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6af2c0000 of size 2359296
2019-11-20 08:23:15.298634: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6af500000 of size 2359296
2019-11-20 08:23:15.298638: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6af740000 of size 2359296
2019-11-20 08:23:15.298642: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6af980000 of size 2359296
2019-11-20 08:23:15.298646: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6afbc0000 of size 4456448
2019-11-20 08:23:15.298651: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b0000000 of size 18874368
2019-11-20 08:23:15.298655: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b1200000 of size 18874368
2019-11-20 08:23:15.298659: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b2400000 of size 9437184
2019-11-20 08:23:15.298663: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b2d00000 of size 9437184
2019-11-20 08:23:15.298667: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b3600000 of size 10485760
2019-11-20 08:23:15.298671: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b4000000 of size 33554432
2019-11-20 08:23:15.298676: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b6000000 of size 221184
2019-11-20 08:23:15.298680: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b6036000 of size 221184
2019-11-20 08:23:15.298684: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b606c000 of size 221184
2019-11-20 08:23:15.298688: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b60a2000 of size 221184
2019-11-20 08:23:15.298693: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b60d8000 of size 221184
2019-11-20 08:23:15.298697: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b610e000 of size 256
2019-11-20 08:23:15.298701: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b610e100 of size 256
2019-11-20 08:23:15.298705: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b610e200 of size 256
2019-11-20 08:23:15.298709: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b610e300 of size 256
2019-11-20 08:23:15.298714: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b610e400 of size 256
2019-11-20 08:23:15.298718: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b610e500 of size 256
2019-11-20 08:23:15.298722: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b610e600 of size 256
2019-11-20 08:23:15.298726: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b610e700 of size 256
2019-11-20 08:23:15.298730: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b610e800 of size 256
2019-11-20 08:23:15.298734: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b610e900 of size 442368
2019-11-20 08:23:15.298739: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b617a900 of size 546560
2019-11-20 08:23:15.298744: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b6200000 of size 442368
2019-11-20 08:23:15.298749: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b626c000 of size 442368
2019-11-20 08:23:15.298753: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b62d8000 of size 442368
2019-11-20 08:23:15.298757: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b6344000 of size 442368
2019-11-20 08:23:15.298761: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b63b0000 of size 256
2019-11-20 08:23:15.298765: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b63b0100 of size 256
2019-11-20 08:23:15.298769: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b63b0200 of size 256
2019-11-20 08:23:15.298774: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b63b0300 of size 256
2019-11-20 08:23:15.298778: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b63b0400 of size 256
2019-11-20 08:23:15.298782: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b63b0500 of size 256
2019-11-20 08:23:15.298786: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b63b0600 of size 110592
2019-11-20 08:23:15.298790: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b63cb600 of size 110592
2019-11-20 08:23:15.298794: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b63e6600 of size 110592
2019-11-20 08:23:15.298798: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b6401600 of size 256
2019-11-20 08:23:15.298802: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b6401700 of size 256
2019-11-20 08:23:15.298806: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b6401800 of size 256
2019-11-20 08:23:15.298810: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b6401900 of size 165888
2019-11-20 08:23:15.298814: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b642a100 of size 165888
2019-11-20 08:23:15.298818: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b6452900 of size 165888
2019-11-20 08:23:15.298822: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b647b100 of size 165888
2019-11-20 08:23:15.298826: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b64a3900 of size 165888
2019-11-20 08:23:15.298830: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b64cc100 of size 165888
2019-11-20 08:23:15.298834: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b64f4900 of size 165888
2019-11-20 08:23:15.298838: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b651d100 of size 165888
2019-11-20 08:23:15.298842: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b6545900 of size 165888
2019-11-20 08:23:15.298846: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b656e100 of size 256
2019-11-20 08:23:15.298850: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b656e200 of size 256
2019-11-20 08:23:15.298855: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b656e300 of size 256
2019-11-20 08:23:15.298859: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b656e400 of size 256
2019-11-20 08:23:15.298863: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b656e500 of size 256
2019-11-20 08:23:15.298867: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b656e600 of size 256
2019-11-20 08:23:15.298871: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b656e700 of size 256
2019-11-20 08:23:15.298875: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b656e800 of size 256
2019-11-20 08:23:15.300524: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b656e900 of size 256
2019-11-20 08:23:15.300547: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b656ea00 of size 595456
2019-11-20 08:23:15.300552: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b6600000 of size 331776
2019-11-20 08:23:15.300556: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b6651000 of size 331776
2019-11-20 08:23:15.300561: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b66a2000 of size 331776
2019-11-20 08:23:15.300564: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b66f3000 of size 331776
2019-11-20 08:23:15.300569: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b6744000 of size 331776
2019-11-20 08:23:15.300573: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b6795000 of size 256
2019-11-20 08:23:15.300577: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b6795100 of size 256
2019-11-20 08:23:15.300581: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b6795200 of size 256
2019-11-20 08:23:15.300585: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b6795300 of size 256
2019-11-20 08:23:15.300589: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b6795400 of size 256
2019-11-20 08:23:15.300593: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b6795500 of size 256
2019-11-20 08:23:15.300597: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b6795600 of size 82944
2019-11-20 08:23:15.300614: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b67a9a00 of size 82944
2019-11-20 08:23:15.300618: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b67bde00 of size 82944
2019-11-20 08:23:15.300622: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b67d2200 of size 256
2019-11-20 08:23:15.300626: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b67d2300 of size 256
2019-11-20 08:23:15.300630: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b67d2400 of size 256
2019-11-20 08:23:15.300634: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b67d2500 of size 360448
2019-11-20 08:23:15.300638: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b682a500 of size 768
2019-11-20 08:23:15.300643: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b682a800 of size 6117376
2019-11-20 08:23:15.300647: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b6e00000 of size 4194304
2019-11-20 08:23:15.300651: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b7200000 of size 4194304
2019-11-20 08:23:15.300655: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b7600000 of size 4096
2019-11-20 08:23:15.300674: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b7601000 of size 4096
2019-11-20 08:23:15.300678: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd6b7602000 o

2019-11-20 08:23:15.303534: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd728806100 of size 256
2019-11-20 08:23:15.305105: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd728806200 of size 221184
2019-11-20 08:23:15.305132: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd72883c200 of size 221184
2019-11-20 08:23:15.305137: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd728872200 of size 221184
2019-11-20 08:23:15.305142: I tensorflow/core/common_runtime/bfc_allocator.cc:632] Chunk at 0x7fd7288a8200 of size 359936
2019-11-20 08:23:15.305146: I tensorflow/core/common_runtime/bfc_allocator.cc:638] Summary of in-use Chunks by size:
2019-11-20 08:23:15.305167: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 425 Chunks of size 256 totalling 106.2KiB
2019-11-20 08:23:15.305186: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 184 Chunks of size 512 totalling 92.0KiB
2019-11-20 08:23:15.305191: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 4 Chunks of size 768 totalling 3.0KiB
2019-11-20 08:23:15.305196: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 188 Chunks of size 1024 totalling 188.0KiB
2019-11-20 08:23:15.305200: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 1 Chunks of size 1280 totalling 1.2KiB
2019-11-20 08:23:15.305205: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 176 Chunks of size 2048 totalling 352.0KiB
2019-11-20 08:23:15.305210: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 10 Chunks of size 4096 totalling 40.0KiB
2019-11-20 08:23:15.305215: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 1 Chunks of size 7680 totalling 7.5KiB
2019-11-20 08:23:15.305219: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 15 Chunks of size 16384 totalling 240.0KiB
2019-11-20 08:23:15.305224: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 1 Chunks of size 26112 totalling 25.5KiB
2019-11-20 08:23:15.305229: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 9 Chunks of size 32768 totalling 288.0KiB
2019-11-20 08:23:15.305234: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 6 Chunks of size 37632 totalling 220.5KiB
2019-11-20 08:23:15.305239: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 9 Chunks of size 65536 totalling 576.0KiB
2019-11-20 08:23:15.305243: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 6 Chunks of size 82944 totalling 486.0KiB
2019-11-20 08:23:15.305261: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 1 Chunks of size 98048 totalling 95.8KiB
2019-11-20 08:23:15.305266: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 6 Chunks of size 110592 totalling 648.0KiB
2019-11-20 08:23:15.305270: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 18 Chunks of size 131072 totalling 2.25MiB
2019-11-20 08:23:15.305275: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 27 Chunks of size 147456 totalling 3.80MiB
2019-11-20 08:23:15.305279: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 14 Chunks of size 165888 totalling 2.21MiB
2019-11-20 08:23:15.305284: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 1 Chunks of size 167936 totalling 164.0KiB
2019-11-20 08:23:15.305288: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 13 Chunks of size 221184 totalling 2.74MiB
2019-11-20 08:23:15.305293: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 15 Chunks of size 262144 totalling 3.75MiB
2019-11-20 08:23:15.305297: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 9 Chunks of size 294912 totalling 2.53MiB
2019-11-20 08:23:15.305302: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 9 Chunks of size 331776 totalling 2.85MiB
2019-11-20 08:23:15.305306: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 1 Chunks of size 359936 totalling 351.5KiB
2019-11-20 08:23:15.305311: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 3 Chunks of size 360448 totalling 1.03MiB
2019-11-20 08:23:15.305315: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 1 Chunks of size 391680 totalling 382.5KiB
2019-11-20 08:23:15.305320: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 9 Chunks of size 442368 totalling 3.80MiB
2019-11-20 08:23:15.305324: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 9 Chunks of size 524288 totalling 4.50MiB
2019-11-20 08:23:15.305329: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 1 Chunks of size 546560 totalling 533.8KiB
2019-11-20 08:23:15.305333: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 21 Chunks of size 589824 totalling 11.81MiB
2019-11-20 08:23:15.305338: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 1 Chunks of size 595456 totalling 581.5KiB
2019-11-20 08:23:15.305343: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 15 Chunks of size 1048576 totalling 15.00MiB
2019-11-20 08:23:15.305348: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 21 Chunks of size 1179648 totalling 23.62MiB
2019-11-20 08:23:15.305352: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 1 Chunks of size 1566720 totalling 1.49MiB
2019-11-20 08:23:15.305357: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 20 Chunks of size 2359296 totalling 45.00MiB
2019-11-20 08:23:15.305361: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 1 Chunks of size 3116544 totalling 2.97MiB
2019-11-20 08:23:15.305366: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 2 Chunks of size 4155392 totalling 7.93MiB
2019-11-20 08:23:15.305370: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 5 Chunks of size 4194304 totalling 20.00MiB
2019-11-20 08:23:15.305375: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 1 Chunks of size 4456448 totalling 4.25MiB
2019-11-20 08:23:15.305379: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 13 Chunks of size 4718592 totalling 58.50MiB
2019-11-20 08:23:15.305384: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 1 Chunks of size 6117376 totalling 5.83MiB
2019-11-20 08:23:15.305388: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 1 Chunks of size 6220800 totalling 5.93MiB
2019-11-20 08:23:15.305392: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 1 Chunks of size 8310784 totalling 7.93MiB
2019-11-20 08:23:15.305397: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 20 Chunks of size 9437184 totalling 180.00MiB
2019-11-20 08:23:15.305402: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 1 Chunks of size 10485760 totalling 10.00MiB
2019-11-20 08:23:15.305406: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 5 Chunks of size 18874368 totalling 90.00MiB
2019-11-20 08:23:15.305411: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 1 Chunks of size 20160768 totalling 19.23MiB
2019-11-20 08:23:15.305416: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 1 Chunks of size 33554432 totalling 32.00MiB
2019-11-20 08:23:15.305420: I tensorflow/core/common_runtime/bfc_allocator.cc:641] 1 Chunks of size 803188224 totalling 765.98MiB
2019-11-20 08:23:15.305425: I tensorflow/core/common_runtime/bfc_allocator.cc:645] Sum Total of in-use chunks: 1.31GiB
2019-11-20 08:23:15.305431: I tensorflow/core/common_runtime/bfc_allocator.cc:647] Stats:
Limit: 5436735488
InUse: 1407395072
MaxInUse: 5061397760
NumAllocs: 21370732
MaxAllocSize: 2644469248

2019-11-20 08:23:15.305484: W tensorflow/core/common_runtime/bfc_allocator.cc:271] *_____________________________________________________________________
2019-11-20 08:23:15.305510: W tensorflow/core/framework/op_kernel.cc:1401] OP_REQUIRES failed at conv_ops.cc:446 : Resource exhausted: OOM when allocating tensor with shape[32,64,540,960] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc
Traceback (most recent call last):
File “/usr/local/bin/tlt-train-g1”, line 10, in
sys.exit(main())
File “./common/magnet_train.py”, line 33, in main
File “./ssd/scripts/train.py”, line 301, in main
File “./ssd/scripts/train.py”, line 245, in run_experiment
File “/usr/local/lib/python2.7/dist-packages/keras/engine/training.py”, line 1039, in fit
validation_steps=validation_steps)
File “/usr/local/lib/python2.7/dist-packages/keras/engine/training_arrays.py”, line 217, in fit_loop
callbacks.on_epoch_end(epoch, epoch_logs)
File “/usr/local/lib/python2.7/dist-packages/keras/callbacks.py”, line 79, in on_epoch_end
callback.on_epoch_end(epoch, logs)
File “./ssd/scripts/train.py”, line 95, in on_epoch_end
File “./ssd/utils/average_precision_evaluator.py”, line 184, in call
File “./ssd/utils/average_precision_evaluator.py”, line 305, in predict_on_dataset
File “/usr/local/lib/python2.7/dist-packages/keras/engine/training.py”, line 1169, in predict
steps=steps)
File “/usr/local/lib/python2.7/dist-packages/keras/engine/training_arrays.py”, line 294, in predict_loop
batch_outs = f(ins_batch)
File “/usr/local/lib/python2.7/dist-packages/keras/backend/tensorflow_backend.py”, line 2715, in call
return self._call(inputs)
File “/usr/local/lib/python2.7/dist-packages/keras/backend/tensorflow_backend.py”, line 2675, in _call
fetched = self._callable_fn(*array_vals)
File “/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py”, line 1439, in call
run_metadata_ptr)
File “/usr/local/lib/python2.7/dist-packages/tensorflow/python/framework/errors_impl.py”, line 528, in exit
c_api.TF_GetCode(self.status.status))
tensorflow.python.framework.errors_impl.ResourceExhaustedError: OOM when allocating tensor with shape[32,64,540,960] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc
[[{{node model_1/conv1/convolution}}]]
Hint: If you want to see a list of allocated tensors when OOM happens, add report_tensor_allocations_upon_oom to RunOptions for current allocation info.

 [[{{node model_1/decoded_predictions/loop_over_batch/while/cond_1/non_maximum_suppresion/NonMaxSuppressionV3/Switch}}]]

Hint: If you want to see a list of allocated tensors when OOM happens, add report_tensor_allocations_upon_oom to RunOptions for current allocation info.

Traceback (most recent call last):
File “/usr/local/bin/tlt-train-g1”, line 10, in
sys.exit(main())
File “./common/magnet_train.py”, line 33, in main
File “./ssd/scripts/train.py”, line 301, in main
File “./ssd/scripts/train.py”, line 245, in run_experiment
File “/usr/local/lib/python2.7/dist-packages/keras/engine/training.py”, line 1039, in fit
validation_steps=validation_steps)
File “/usr/local/lib/python2.7/dist-packages/keras/engine/training_arrays.py”, line 154, in fit_loop
outs = f(ins)
File “/usr/local/lib/python2.7/dist-packages/keras/backend/tensorflow_backend.py”, line 2715, in call
return self._call(inputs)
File “/usr/local/lib/python2.7/dist-packages/keras/backend/tensorflow_backend.py”, line 2675, in _call
fetched = self._callable_fn(*array_vals)
File “/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py”, line 1439, in call
run_metadata_ptr)
File “/usr/local/lib/python2.7/dist-packages/tensorflow/python/framework/errors_impl.py”, line 528, in exit
c_api.TF_GetCode(self.status.status))
tensorflow.python.framework.errors_impl.UnknownError: Horovod has been shut down. This was caused by an exception on one of the ranks or an attempt to allreduce, allgather or broadcast a tensor after one of the ranks finished execution. If the shutdown was caused by an exception, you should see the exception in the log before the first shutdown message.
[[{{node training_1/SGD/DistributedSGD_Allreduce/HorovodAllreduce_training_1_SGD_gradients_bn_conv1_1_FusedBatchNorm_grad_FusedBatchNormGrad_2}}]]
[[{{node training_1/SGD/DistributedSGD_Allreduce/HorovodAllreduce_training_1_SGD_gradients_block_4b_bn_shortcut_1_FusedBatchNorm_grad_FusedBatchNormGrad_1}}]]
Producing predictions batch-wise: 0% 0/14 [00:16<?, ?it/s]

Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.


mpirun.real detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:

Process name: [[20479,1],1]
Exit code: 1

print(‘Model for each epoch:’)
Also tried !export TF_FORCE_GPU_ALLOW_GROWTH=true
but ended up with same after 10 epochs

Hi psgr,
Could you please attach your training spec file?

Hi Morganh,

I hope it’s because the batch size of the evaluation is too high in spec file which is giving me the OOM. Just changed it and didn’t face any issue after 10th epoch. Maybe that’s what has been the bottleneck for training.

Thanks for the help.

Hi psgr,
Your original mentioned issue is from evaluation instead of training, right?

If for evaluation, please set below

$ export TF_FORCE_GPU_ALLOW_GROWTH=true

From your last comment, you already run without any issue, right?