Key result
Active learning using a least confidence score strategy achieved an F1 score of 0.85 for detecting premature ventricular contractions, outperforming the same classifier trained on the full dataset.
Why the study?
Supervised learning algorithms can detect premature ventricular contractions from beat-level ECG data, but substantial human effort is required for accurate detection.
Active learning strategies can significantly reduce human annotation effort for PVC detection in ECGs while maintaining or improving classification performance.
Answers are grounded in this paper and cite their sources.
May reduce labeling needs for PVC detection; leaves open clinical validation and outcome impact.
Premature ventricular contractions (PVCs) are one of the most common cardiovascular diseases with high risk to a large population of patients. It has been shown that supervised learning algorithms can detect PVCs from beat-level ECG data. However, a huge human effort is needed in order to achieve an accurate detection rate. A convolutional autoencoder was trained in this work in an unsupervised fashion to extract features automatically with zero prior specialized knowledge. Random forest was adopted as a supervised algorithm trained on the features generated by the autoencoder. Various active learning selection strategies, uncertainty-based and diversity-based, were studied on top of the random forest. In each iteration of active learning, the training data are updated with newly selected samples and fed into the classifier. The performance on an independent validation set is recorded in each iteration. As a result, among the different uncertainty sampling strategies, the least confidence score shows a better F1 score of 0.85 than other methods. In between the two diversity-based strategies, the representative clustering sample had the best F1 score than the k-center-greedy algorithm. By comparing the performance of different active learning methods trained on half of the original data size with the same classifier trained on the full set, the F1 score of least confidence is still better than the full set. This study demonstrates that active learning could help reduce human annotation effort by achieving the same level of performance as the classifier trained on the fully annotated training data.
No takes yet. Share an insight, caveat, or question.
Zhang et al. (2021) studied Premature ventricular contractions (PVCs). Active learning selection strategies (uncertainty-based and diversity-based) vs. Classifier trained on the fully annotated training data was evaluated on F1 score for PVC detection. Active learning using a least confidence score strategy achieved an F1 score of 0.85 for detecting premature ventricular contractions, outperforming the same classifier trained on the full dataset.
Synapse has enriched 10 related papers. Consider them for comparative context: