I am testing VehicleMakeNet(unpruned) model on CompCars sv dataset, where instead of model target label brand target label is used. For instance “audi Q3” target label is replaced by “audi”.
When launching evaluate function with config(below) the model scores 64.3 accuracy and 71.36 accuracy on cropped images. However, on Nvidia proprietary dataset the model hits 91 accuracy. I wonder what may cause such difference in accuracy and would appreciate any comments, concerning the issue.