Key result
The MI3 algorithm demonstrated very high discrimination for type 1 NSTEMI and had higher specificity but lower sensitivity compared to the ESC 0/1h-algorithm.
Why the study?
The performance of the MI3 machine learning algorithm was unknown when the interval between serial troponin measurements was less than 3 hours, requiring external validation before clinical use.
Does the MI3 algorithm accurately diagnose type 1 NSTEMI compared to the ESC 0/1h-algorithm in patients presenting with symptoms suggestive of MI?
Observational (n=6,487)
Blinded
Yes
Does the MI3 algorithm accurately diagnose type 1 NSTEMI compared to the ESC 0/1h-algorithm in patients presenting with symptoms suggestive of MI?
Answers are grounded in this paper and cite their sources.
Captured external expert commentary on this paper, strongest first. Original sources are linked where available.
“This intriguing study shows how AI can use complex analysis, rather than a simple rule, to improve diagnosis. This doesn't (yet) show that we can replace doctors with computers. Experienced clinicians know that diagnosis is a complex business. Indeed, the 'ground truth' used to judge whether the AI algorithm was accurate was a judgement made by clinicians.”
The MI3 machine learning algorithm provides excellent discrimination for early diagnosis of type 1 NSTEMI, with higher specificity and positive predictive value but slightly lower sensitivity than the standard ESC 0/1h-algorithm.
Introduction The myocardial-ischemic-injury-index (MI3) is a machine learning algorithm derived in 2019 for the early diagnosis of type 1 non-ST-elevation myocardial infarction (NSTEMI). MI3 incorporates age, sex, and two high-sensitivity cardiac troponin I (hs-cTnI) Architecht measurements. The performance of the MI3 algorithm is unknown in a setting where the time difference between the first and second troponin measurement is less than 3 hours. Thus, external validation seems mandatory before this algorithm could be considered for clinical use. Purpose To externally validate the performance of the MI3 algorithm and compare its performance with the ESC 0/1h-algorithm, the recommended algorithm by the European Society of Cardiology NSTEMI guidelines. Methods In a multicentre international diagnostic study, we prospectively enrolled unselected patients presenting to the emergency department with symptoms suggestive of MI. Final diagnoses were centrally adjudicated by two independent cardiologists using all available medical records, including cardiac imaging, serial hs-cTn and 90-days follow-up. Hs-cTnI (Architect) concentrations were measured in a blinded fashion at presentation and serially thereafter. The primary endpoint was type 1 NSTEMI during the index visit. Results Among 6487 patients with two available hs-cTnI concentrations, type 1 NSTEMI was the adjudicated final diagnosis in 882 (13.6%) patients. The median time difference between blood draws was 60 minutes (IQR: 57-70). Model performance was good, with a very high area under the receiver-operating-characteristic curve (0.961 [95% CI: 0.957-0.965]) and an optimal calibration overall (intercept -0.09 [-0.2-0.02]; slope 1.02 [0.97-1.08]), Figure 1. The originally defined low-probability MI3 score<1.6 and high-probability MI3 score≥49.7 triaged 4186 (64.5%) patients towards rule-out (sensitivity 99.1% [98.2-99.5]; negative predictive value [NPV] 99.8% [99.6-99.9]) and 915 (14.1%) patients towards rule-in (specificity 95.0% [94.3-95.5]; positive predictive value [PPV] 69.1% [66.0-72.0]), respectively (Figure 2). Both the sensitivity and the NPV of the ESC 0/1h-algorithm were greater than of the MI3 algorithm (difference for sensitivity: 0.84% [0.18-1.51], P=0.008; difference for NPV: 0.18% [0.05-0.33], P=0.016). In contrast, the specificity and PPV for the MI3 algorithm were higher (difference for specificity: 3.85% [3.29-4.40], P<0.001; difference for PPV: 7.82% [5.9-9.74], P<0.001). Conclusion In patients with two hs-cTnI (Architect) measurements with a median time difference of 60 minutes, the MI3 algorithm showed a very high discrimination and good calibration for type 1 NSTEMI.
No takes yet. Share an insight, caveat, or question.
Boeddinghaus et al. (2023) conducted an observational in Myocardial Infarction (n=6,487). Myocardial-ischemic-injury-index (MI3) algorithm vs. ESC 0/1h-algorithm was evaluated on Type 1 NSTEMI during the index visit (AUC 0.961, 95% CI 0.957-0.965). The MI3 algorithm demonstrated very high discrimination for type 1 NSTEMI and had higher specificity but lower sensitivity compared to the ESC 0/1h-algorithm.
Synapse has enriched 10 related papers. Consider them for comparative context: