Epoch 00001: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_001.tlt Epoch 2/80 668/668 [==============================] - 209s 313ms/step - loss: 14.2930 Epoch 00002: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_002.tlt Epoch 3/80 668/668 [==============================] - 210s 315ms/step - loss: 13.8054 Epoch 00003: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_003.tlt Epoch 4/80 668/668 [==============================] - 216s 323ms/step - loss: 13.5021 Epoch 00004: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_004.tlt Epoch 5/80 668/668 [==============================] - 211s 316ms/step - loss: 13.1732 Epoch 00005: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_005.tlt Epoch 6/80 668/668 [==============================] - 212s 317ms/step - loss: 12.6887 Epoch 00006: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_006.tlt Epoch 7/80 668/668 [==============================] - 213s 319ms/step - loss: 12.1880 Epoch 00007: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_007.tlt Epoch 8/80 668/668 [==============================] - 211s 316ms/step - loss: 11.7478 Epoch 00008: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_008.tlt Epoch 9/80 668/668 [==============================] - 212s 317ms/step - loss: 11.2717 Epoch 00009: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_009.tlt Epoch 10/80 668/668 [==============================] - 209s 313ms/step - loss: 10.7282 Epoch 00010: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_010.tlt Producing predictions: 100%|████████████████████| 75/75 [00:08<00:00, 8.56it/s] Start to calculate AP for each class ******************************* person AP 0.58569 mAP 0.58569 ******************************* Validation loss: 54.56895936630108 Epoch 11/80 668/668 [==============================] - 212s 317ms/step - loss: 10.1008 Epoch 00011: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_011.tlt Epoch 12/80 668/668 [==============================] - 214s 321ms/step - loss: 9.2296 Epoch 00012: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_012.tlt Epoch 13/80 668/668 [==============================] - 212s 317ms/step - loss: 12.4690 Epoch 00013: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_013.tlt Epoch 14/80 668/668 [==============================] - 209s 313ms/step - loss: 10.7320 Epoch 00014: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_014.tlt Epoch 15/80 668/668 [==============================] - 212s 318ms/step - loss: 9.5469 Epoch 00015: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_015.tlt Epoch 16/80 668/668 [==============================] - 210s 315ms/step - loss: 8.7651 Epoch 00016: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_016.tlt Epoch 17/80 668/668 [==============================] - 216s 324ms/step - loss: 8.1393 Epoch 00017: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_017.tlt Epoch 18/80 668/668 [==============================] - 209s 313ms/step - loss: 8.0008 Epoch 00018: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_018.tlt Epoch 19/80 668/668 [==============================] - 211s 316ms/step - loss: 7.8545 Epoch 00019: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_019.tlt Epoch 20/80 668/668 [==============================] - 213s 318ms/step - loss: 7.4153 Epoch 00020: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_020.tlt Producing predictions: 100%|████████████████████| 75/75 [00:07<00:00, 10.12it/s] Start to calculate AP for each class ******************************* person AP 0.00256 mAP 0.00256 ******************************* Validation loss: 76.45231677105976 Epoch 21/80 668/668 [==============================] - 212s 318ms/step - loss: 7.5400 Epoch 00021: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_021.tlt Epoch 22/80 668/668 [==============================] - 209s 312ms/step - loss: 8.5290 Epoch 00022: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_022.tlt Epoch 23/80 668/668 [==============================] - 212s 317ms/step - loss: 8.0287 Epoch 00023: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_023.tlt Epoch 24/80 668/668 [==============================] - 208s 311ms/step - loss: 7.5933 Epoch 00024: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_024.tlt Epoch 25/80 668/668 [==============================] - 214s 321ms/step - loss: 7.2255 Epoch 00025: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_025.tlt Epoch 26/80 668/668 [==============================] - 211s 316ms/step - loss: 6.8921 Epoch 00026: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_026.tlt Epoch 27/80 668/668 [==============================] - 210s 315ms/step - loss: 6.6766 Epoch 00027: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_027.tlt Epoch 28/80 668/668 [==============================] - 209s 313ms/step - loss: 6.4833 Epoch 00028: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_028.tlt Epoch 29/80 668/668 [==============================] - 212s 318ms/step - loss: 6.3695 Epoch 00029: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_029.tlt Epoch 30/80 668/668 [==============================] - 212s 317ms/step - loss: 6.2514 Epoch 00030: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_030.tlt Producing predictions: 100%|████████████████████| 75/75 [00:06<00:00, 11.03it/s] Start to calculate AP for each class ******************************* person AP 0.00242 mAP 0.00242 ******************************* Validation loss: 75.21410413901145 Epoch 31/80 668/668 [==============================] - 210s 315ms/step - loss: 6.1557 Epoch 00031: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_031.tlt Epoch 32/80 668/668 [==============================] - 213s 319ms/step - loss: 6.0841 Epoch 00032: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_032.tlt Epoch 33/80 668/668 [==============================] - 212s 318ms/step - loss: 6.0771 Epoch 00033: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_033.tlt Epoch 34/80 668/668 [==============================] - 210s 314ms/step - loss: 5.9809 Epoch 00034: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_034.tlt Epoch 35/80 668/668 [==============================] - 214s 320ms/step - loss: 5.8433 Epoch 00035: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_035.tlt Epoch 36/80 668/668 [==============================] - 211s 316ms/step - loss: 5.8618 Epoch 00036: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_036.tlt Epoch 37/80 668/668 [==============================] - 213s 319ms/step - loss: 5.8420 Epoch 00037: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_037.tlt Epoch 38/80 668/668 [==============================] - 215s 322ms/step - loss: 5.7678 Epoch 00038: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_038.tlt Epoch 39/80 668/668 [==============================] - 210s 314ms/step - loss: 5.7514 Epoch 00039: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_039.tlt Epoch 40/80 668/668 [==============================] - 212s 318ms/step - loss: 5.7642 Epoch 00040: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_040.tlt Producing predictions: 100%|████████████████████| 75/75 [00:06<00:00, 10.82it/s] Start to calculate AP for each class ******************************* person AP 0.00765 mAP 0.00765 ******************************* Validation loss: 75.37661305936123 Epoch 41/80 668/668 [==============================] - 211s 316ms/step - loss: 5.6963 Epoch 00041: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_041.tlt Epoch 42/80 668/668 [==============================] - 209s 313ms/step - loss: 5.7182 Epoch 00042: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_042.tlt Epoch 43/80 668/668 [==============================] - 210s 314ms/step - loss: 5.6174 Epoch 00043: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_043.tlt Epoch 44/80 668/668 [==============================] - 211s 316ms/step - loss: 5.5551 Epoch 00044: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_044.tlt Epoch 45/80 668/668 [==============================] - 215s 322ms/step - loss: 5.5020 Epoch 00045: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_045.tlt Epoch 46/80 668/668 [==============================] - 213s 319ms/step - loss: 5.4945 Epoch 00046: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_046.tlt Epoch 47/80 668/668 [==============================] - 211s 316ms/step - loss: 5.4576 Epoch 00047: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_047.tlt Epoch 48/80 668/668 [==============================] - 211s 316ms/step - loss: 5.4284 Epoch 00048: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_048.tlt Epoch 49/80 668/668 [==============================] - 209s 313ms/step - loss: 5.3958 Epoch 00049: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_049.tlt Epoch 50/80 668/668 [==============================] - 209s 313ms/step - loss: 5.4144 Epoch 00050: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_050.tlt Producing predictions: 100%|████████████████████| 75/75 [00:07<00:00, 10.69it/s] Start to calculate AP for each class ******************************* person AP 0.01009 mAP 0.01009 ******************************* Validation loss: 75.5150916702926 Epoch 51/80 668/668 [==============================] - 207s 311ms/step - loss: 5.4852 Epoch 00051: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_051.tlt Epoch 52/80 668/668 [==============================] - 210s 314ms/step - loss: 5.4349 Epoch 00052: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_052.tlt Epoch 53/80 668/668 [==============================] - 209s 312ms/step - loss: 5.3862 Epoch 00053: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_053.tlt Epoch 54/80 668/668 [==============================] - 210s 315ms/step - loss: 5.3563 Epoch 00054: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_054.tlt Epoch 55/80 668/668 [==============================] - 209s 313ms/step - loss: 5.3215 Epoch 00055: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_055.tlt Epoch 56/80 668/668 [==============================] - 211s 316ms/step - loss: 5.3052 Epoch 00056: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_056.tlt Epoch 57/80 668/668 [==============================] - 210s 315ms/step - loss: 5.3087 Epoch 00057: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_057.tlt Epoch 58/80 668/668 [==============================] - 212s 317ms/step - loss: 5.2834 Epoch 00058: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_058.tlt Epoch 59/80 668/668 [==============================] - 209s 313ms/step - loss: 5.2401 Epoch 00059: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_059.tlt Epoch 60/80 668/668 [==============================] - 212s 318ms/step - loss: 5.2382 Epoch 00060: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_060.tlt Producing predictions: 100%|████████████████████| 75/75 [00:07<00:00, 10.51it/s] Start to calculate AP for each class ******************************* person AP 0.01414 mAP 0.01414 ******************************* Validation loss: 79.0692285475052 Epoch 61/80 668/668 [==============================] - 208s 311ms/step - loss: 5.2247 Epoch 00061: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_061.tlt Epoch 62/80 668/668 [==============================] - 211s 316ms/step - loss: 5.2139 Epoch 00062: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_062.tlt Epoch 63/80 668/668 [==============================] - 212s 317ms/step - loss: 5.2230 Epoch 00063: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_063.tlt Epoch 64/80 668/668 [==============================] - 215s 322ms/step - loss: 5.2060 Epoch 00064: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_064.tlt Epoch 65/80 668/668 [==============================] - 211s 316ms/step - loss: 5.1684 Epoch 00065: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_065.tlt Epoch 66/80 668/668 [==============================] - 213s 319ms/step - loss: 5.1463 Epoch 00066: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_066.tlt Epoch 67/80 668/668 [==============================] - 210s 315ms/step - loss: 5.1481 Epoch 00067: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_067.tlt Epoch 68/80 668/668 [==============================] - 208s 311ms/step - loss: 5.1141 Epoch 00068: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_068.tlt Epoch 69/80 668/668 [==============================] - 208s 311ms/step - loss: 5.0945 Epoch 00069: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_069.tlt Epoch 70/80 668/668 [==============================] - 212s 317ms/step - loss: 5.0601 Epoch 00070: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_070.tlt Producing predictions: 100%|████████████████████| 75/75 [00:06<00:00, 11.06it/s] Start to calculate AP for each class ******************************* person AP 0.06475 mAP 0.06475 ******************************* Validation loss: 72.33614758714067 Epoch 71/80 668/668 [==============================] - 208s 311ms/step - loss: 5.0481 Epoch 00071: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_071.tlt Epoch 72/80 668/668 [==============================] - 211s 315ms/step - loss: 5.0310 Epoch 00072: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_072.tlt Epoch 73/80 668/668 [==============================] - 209s 313ms/step - loss: 5.0087 Epoch 00073: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_073.tlt Epoch 74/80 668/668 [==============================] - 208s 311ms/step - loss: 4.9741 Epoch 00074: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_074.tlt Epoch 75/80 668/668 [==============================] - 214s 320ms/step - loss: 4.9792 Epoch 00075: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_075.tlt Epoch 76/80 668/668 [==============================] - 210s 315ms/step - loss: 4.9484 Epoch 00076: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_076.tlt Epoch 77/80 668/668 [==============================] - 205s 308ms/step - loss: 4.9240 Epoch 00077: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_077.tlt Epoch 78/80 668/668 [==============================] - 207s 310ms/step - loss: 4.9398 Epoch 00078: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_078.tlt Epoch 79/80 668/668 [==============================] - 210s 315ms/step - loss: 4.9121 Epoch 00079: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_079.tlt Epoch 80/80 668/668 [==============================] - 210s 314ms/step - loss: 4.9000 Epoch 00080: saving model to /home/ivis/tlt1/Person_tlt/ssd/experiment_dir_unpruned/weights/ssd_resnet34_epoch_080.tlt Producing predictions: 100%|████████████████████| 75/75 [00:06<00:00, 10.94it/s] Start to calculate AP for each class ******************************* person AP 0.04874 mAP 0.04874 ******************************* Validation loss: 69.00637084732763 2021-04-19 16:59:55,630 [INFO] tlt.components.docker_handler.docker_handler: Stopping container.