Key result
Custom CNN ensemble reduces inappropriate AF detection in implantable cardiac monitors by ~90%.
Why the study?
The authors investigated an application-specific CNN using a custom ensemble of features based on AF ECG characteristics to reduce inappropriate AF detections in ICMs.
Does a custom ensemble of features-based CNN reduce inappropriate atrial fibrillation detections in implantable cardiac monitors compared to standard models?
Does a custom ensemble of features-based CNN reduce inappropriate atrial fibrillation detections in implantable cardiac monitors compared to standard models?
Absolute Event Rate: 0.993% vs 0.991%
A custom ensemble of features-based deep learning model significantly reduces inappropriate atrial fibrillation detections in implantable cardiac monitors while preserving high sensitivity.
BackgroundMultiple studies have reported on classification of raw electrocardiograms (ECGs) using convolutional neural networks (CNNs).ObjectiveWe investigated an application-specific CNN using a custom ensemble of features designed based on characteristics of the ECG during atrial fibrillation (AF) to reduce inappropriate AF detections in implantable cardiac monitors (ICMs).MethodsAn ensemble of features was developed and combined to form an input signal for the CNN. The features were based on the morphological characteristics of AF, incoherence of RR intervals, and the fact that AF begets more AF. A custom CNN model and the RESNET18 model were trained using ICM-detected AF episodes that were adjudicated to be true AF or false detections. The trained models were evaluated using a test dataset from independent patients.ResultsThe training and validation datasets consisted of 31,757 AF episodes (2516 patients) and 28,506 false episodes (2126 patients). The validation set (20% randomly chosen episodes of each type) had an area under the curve of 0.996 for custom CNN (0.993 for RESNET18). Thresholds were chosen to obtain a relative sensitivity and specificity of 99.2% and 92.8%, respectively (99.2% and 87.9% for RESNET18, respectively). The performance in the independent test set (4546 AF episodes from 418 patients; 5384 false episodes from 605 patients) showed an area under the curve of 0.993 (0.991 for RESNET18) and relative sensitivity and specificity of 98.7% and 91.4%, respectively, at chosen thresholds (98.9% and 88.2% for RESNET18, respectively).ConclusionAn ensemble of features-based CNNs was developed that reduced inappropriate AF detection in ICMs by over 90% while preserving sensitivity. Multiple studies have reported on classification of raw electrocardiograms (ECGs) using convolutional neural networks (CNNs). We investigated an application-specific CNN using a custom ensemble of features designed based on characteristics of the ECG during atrial fibrillation (AF) to reduce inappropriate AF detections in implantable cardiac monitors (ICMs). An ensemble of features was developed and combined to form an input signal for the CNN. The features were based on the morphological characteristics of AF, incoherence of RR intervals, and the fact that AF begets more AF. A custom CNN model and the RESNET18 model were trained using ICM-detected AF episodes that were adjudicated to be true AF or false detections. The trained models were evaluated using a test dataset from independent patients. The training and validation datasets consisted of 31,757 AF episodes (2516 patients) and 28,506 false episodes (2126 patients). The validation set (20% randomly chosen episodes of each type) had an area under the curve of 0.996 for custom CNN (0.993 for RESNET18). Thresholds were chosen to obtain a relative sensitivity and specificity of 99.2% and 92.8%, respectively (99.2% and 87.9% for RESNET18, respectively). The performance in the independent test set (4546 AF episodes from 418 patients; 5384 false episodes from 605 patients) showed an area under the curve of 0.993 (0.991 for RESNET18) and relative sensitivity and specificity of 98.7% and 91.4%, respectively, at chosen thresholds (98.9% and 88.2% for RESNET18, respectively). An ensemble of features-based CNNs was developed that reduced inappropriate AF detection in ICMs by over 90% while preserving sensitivity.
No takes yet. Share an insight, caveat, or question.
Sarkar et al. (2022) studied Atrial fibrillation (n=5,665). Custom ensemble of features-based CNN vs. RESNET18 model was evaluated on Area under the curve (AUC) for AF detection in the independent test set. A custom ensemble of features-based CNN achieved an AUC of 0.993 with 98.7% sensitivity and 91.4% specificity, reducing inappropriate AF detection in implantable cardiac monitors by over 90%.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: