We have been working on YOLO v4 for a few months now, and we have already discussed this topic
please check - Yolo v4 Giving 0.0 AP for less images class
Our loss values, validation loss, and AP score per class are not problematic. However, despite the convergence of loss and validation loss, we are encountering low confidence scores for detected classes in our inference results.