Answers are grounded in this paper and cite their sources.
Supervised machine learning has presented impressive results in the industrial domain - when it can depend on reliable ground truth labels. However, the concept of golden labels often represents only an idealization of reality. Instead, data labeling can be highly subjective and hence susceptible to corruption, such as unintentional errors, resulting in socalled label noise. Since label noise can significantly impair the performance of supervised machine learning models, it can be helpful to assess their robustness to label noise when evaluating existing limitations. Despite the large number of publications offering best practices and techniques for making models more robust to label noise, literature lacks generic tools that would allow data scientists and industrial practitioners to test and compare which technique works best for their given model. To address this gap, we propose a model-agnostic, reusable framework for measuring the robustness of supervised machine learning models to label noise.
No takes yet. Share an insight, caveat, or question.
Dix et al. (2025) studied this question.