Consistency of the Dataset

Do you check the Dataset on consistency and inconsistency before the training of the KI?

Am I correct in assuming that there is data that does not lead to convergence?