Key result
Self-learning label correction improved the challenge score by approximately 3% for the PhysioNet/CinC 2021 dataset and accuracy by 5% for the MNIST dataset under high levels of label noise.
Why the study?
Aggregating small ECG datasets creates label noise from observer variability and expertise differences, which can impair model performance and generalizability.
Self-learning label correction can effectively mitigate the impact of unknown label noise in large heterogeneous ECG datasets, improving classification performance even with a reduced number of leads.
Label noise may degrade ECG classification models; leaves open optimal mitigation strategies for aggregated clinical datasets.
Objective . Learning to classify cardiac abnormalities requires large and high-quality labeled datasets, which is a challenge in medical applications. Small datasets from various sources are often aggregated to meet this requirement, resulting in a final dataset prone to label noise due to inter- and intra-observer variability and different expertise. It is well known that label noise can affect the performance and generalizability of the trained models. In this work, we explore the impact of label noise and self-learning label correction on the classification of cardiac abnormalities on large heterogeneous datasets of electrocardiogram (ECG) signals. Approach. A state-of-the-art self-learning multi-class label correction method for image classification is adapted to learn a multi-label classifier for electrocardiogram signals. We evaluated our performance using 5-fold cross-validation on the publicly available PhysioNet/Computing in Cardiology (CinC) 2021 Challenge data, with full and reduced sets of leads. Due to the unknown label noise in the testing set, we tested our approach on the MNIST dataset. We investigated the performance under different levels of structured label noise for both datasets. Main results. Under high levels of noise, the cross-validation results of self-learning label correction show an improvement of approximately 3% in the challenge score for the PhysioNet/CinC 2021 Challenge dataset and an improvement in accuracy of 5% and reduction of the expected calibration error of 0.03 for the MNIST dataset. We demonstrate that self-learning label correction can be used to effectively deal with the presence of unknown label noise, also when using a reduced number of ECG leads.
No takes yet. Share an insight, caveat, or question.
Vázquez et al. (2022) studied Cardiac abnormalities. Self-learning label correction was evaluated on Challenge score (PhysioNet/CinC 2021) and accuracy (MNIST). Self-learning label correction improved the challenge score by approximately 3% for the PhysioNet/CinC 2021 dataset and accuracy by 5% for the MNIST dataset under high levels of label noise.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: