Nvidia forums don’t allow zip files, only jpeg, pdf, logzz types. What error are you experiencing when you try to click the onedrive link? Here is a google drive link with the same file:
I’ll test out that
soft_start parameter this afternoon, although in other training frameworks that use a similar learning-rate scheduler, we still don’t see this drastic of a change in model performance in the beginning of re-training.
I also disagree with your statement that my graph “proves that pretrained model helps”. You state that at epoch 50 the pre-trained model is higher than no-pretrained model, which is true, but at epochs 80 and 85, the pre-trained model is LOWER than the no-pretrained model. I think these fluctuations are merely a result of random weight initialization.