Key result
Engineered ECG classifiers lose ~20 percentage points in balanced accuracy during cross-dataset transfer.
Why the study?
ECG-based MI classifiers may achieve high internal validation performance but show reduced performance when applied to data from another source.
Do engineered 12-lead ECG feature families and classical machine learning classifiers maintain diagnostic balanced accuracy for binary Healthy-versus-MI classification under strict source-only cross-dataset transfer between a clinical hospital chest-pain cohort and the public PTB-XL dataset?
Observational (n=14,870)
No
Do engineered 12-lead ECG feature families and classical machine learning classifiers maintain diagnostic balanced accuracy for binary Healthy-versus-MI classification under strict source-only cross-dataset transfer between a clinical hospital chest-pain cohort and the public PTB-XL dataset?
Engineered 12-lead ECG feature classifiers for myocardial infarction exhibit a substantial performance and operating-threshold transportability drop when transferred strictly without recalibration between a clinical hospital cohort and the public PTB-XL dataset, rendering uncalibrated source-only models unsuitable for clinical screening.
Answers are grounded in this paper and cite their sources.
Uncalibrated source-only ECG classifiers risk poor MI accuracy in new datasets; challenges transportability assumptions and requires recalibration.
Background/Objectives: Electrocardiogram (ECG)-based myocardial infarction (MI) classifiers may achieve high internal validation performance but show reduced performance when applied to data from another source. The task is a controlled binary healthy-versus-MI benchmark and is not intended to represent real-world chest-pain triage or autonomous clinical deployment. This study evaluated the source-only transportability of engineered 12-lead ECG feature families for binary healthy-versus-MI classification across a cardiologist-annotated hospital dataset and PTB-XL. Methods: The hospital dataset contained 1749 usable recordings from 1434 patients after excluding 206 broken-data records, with 1550 Healthy and 199 MI recordings. The matched PTB-XL binary subset contained 14,982 recordings from 13,436 patients, with 9513 Healthy and 5469 MI recordings. Eleven engineered feature families and five classifier families were compared under preprocessing, patient-aware splitting, source-validation hyperparameter and threshold selection, and bootstrap uncertainty estimation. The reported leading rows are the highest observed configurations in a prespecified benchmark grid, not locked clinical models. Results: Internal performance was higher than strict source-only transfer performance. In the hospital dataset, fiducial interval descriptors with Extra Trees reached balanced accuracy 0.775 and receiver operating characteristic area under the curve (ROC-AUC) 0.855. In PTB-XL, a broad hybrid feature bank with ST-segment information and XGBoost reached a balanced accuracy of 0.898 and ROC-AUC of 0.965. Strict source-only transfer was weaker and asymmetric: the highest observed balanced accuracy was 0.580 for hospital-to-PTB-XL transfer and 0.632 for PTB-XL-to-hospital transfer. Ranking transportability and operating-threshold transportability diverged, most notably for hospital-to-PTB-XL transfer, where ROC-AUC was 0.774 but sensitivity at the source-selected threshold was only 0.164. A secondary target-threshold analysis improved balanced accuracy to 0.682 and 0.640, respectively, but this used target labels only to re-select the operating threshold and was not a strict source-only result. Conclusions: The findings indicate a transportability gap: PTB-XL-to-hospital transfer was more balanced than hospital-to-PTB-XL transfer, but neither direction achieved performance comparable to internal validation. The source-only operating-point results are not acceptable for clinical MI screening or decision support without additional calibration, target-setting validation, and prospective assessment.
No takes yet. Share an insight, caveat, or question.
Aydın et al. (2026) conducted an observational in Myocardial infarction vs. healthy ECG classification (n=14,870). Engineered 12-lead ECG feature families and classical machine learning classifiers under strict source-only cross-dataset transfer vs. Internal dataset validation (within hospital dataset and within PTB-XL) was evaluated on Balanced accuracy for binary healthy-versus-MI classification under strict source-only cross-dataset transfer (hospital-to-PTB-XL) (Balanced accuracy 0.580 (hospital-to-PTB-XL transfer) and 0.632 (PTB-XL-to-hospital transfer), 95% CI 0.563-0.599). Engineered 12-lead ECG classifiers showed reduced strict source-only transfer balanced accuracy (0.580 and 0.632) compared to internal validation (0.775 in hospital and 0.898 in PTB-XL).
Synapse has enriched 10 related papers. Consider them for comparative context: