I can reproduce your error if I directly leverage the spec of resnet18.
For mobilenet_v2, please modify the max_learning_rate to a lower value. For example,
max_learning_rate: 2e-3
I run with this hyperparameter agianst KITTI dataset, the mAP 0 issue is gone.
Please try on your own dataset too.