I ran resnet18 with your shared spec file and small_train_dataset. But I cannot reproduce.
After “Epoch 1/1”, it cost about 10s to start the progress of 1 epoch.
I ran on Geforce 1080 Ti gpu card.
Could you double check? Or check NVIDIA TAO Documentation ?