Key result
Auto-major cardiovascular events matches human clinical event adjudication with ~97% agreement for cardiovascular death.
Why the study?
Medical records review by a physician clinical events committee is the conventional standard for adjudicating MACE in global randomized trials but is labor intensive, motivating development of AI-based adjudication.
Does an AI-based automated adjudication system (Auto-MACE) accurately replicate human Clinical Events Committee (CEC) adjudication of major adverse cardiovascular events and preserve trial treatment effect estimates in patients with acute myocardial infarction?
Does an AI-based automated adjudication system (Auto-MACE) accurately replicate human Clinical Events Committee (CEC) adjudication of major adverse cardiovascular events and preserve trial treatment effect estimates in patients with acute myocardial infarction?
Answers are grounded in this paper and cite their sources.
A dual-model AI adjudication system (Auto-MACE) achieves high concordance with human physician committees on confident cases and reproduces trial treatment effect estimates, offering a viable hybrid strategy to reduce clinical trial workload and cost.
BACKGROUND: Major adverse cardiovascular events (MACE)-cardiovascular (CV) death, nonfatal myocardial infarction (MI), and nonfatal stroke-are highly relevant clinical outcomes. In global randomized trials, medical records review by a physician clinical events committee (CEC) is the conventional standard for adjudicating MACE but is labor intensive. Automated adjudication with the use of artificial intelligence (AI) could reduce cost and improve reproducibility. OBJECTIVES: In this study, the authors sought to develop and validate an AI-based adjudication system for MACE and compare its performance with CEC adjudication in a large global randomized trial. METHODS: We developed an AI-based system ("Auto-MACE") that uses an iteratively refined prompt of the OpenAI o1-mini language model to adjudicate MACE events, and a Clinical Longformer model trained on adjudicated events to assign a confidence level. We validated Auto-MACE against CEC adjudication in the PARADISE-MI global clinical trial comparing sacubitril/valsartan and ramipril in 5,661 patients with MI complicated by systolic dysfunction or pulmonary congestion. RESULTS: Auto-MACE provided a confident adjudication in 315/455 deaths (69%), 301/659 potential MIs (46%), and 136/167 potential strokes (81%). Auto-MACE agreed with the CEC adjudication in 97%, 89%, and 88% of confident events, respectively. Among all events, Auto-MACE agreed with CEC adjudications in 86% of deaths, 76% of potential MIs, and 84% of potential strokes. The estimated effect of sacubitril/valsartan vs ramipril on composite MACE was similar with Auto-MACE adjudication (HR: 0.91; 95% CI: 0.78-1.07) and CEC adjudication (HR: 0.90; 95% CI: 0.77-1.05). CONCLUSIONS: AI-based adjudication of MACE showed high agreement with human CEC adjudication, especially for CV death and stroke, and where the model was confident. Initial AI-based adjudication with CEC review of uncertain events may reduce workload while maintaining accuracy.
No takes yet. Share an insight, caveat, or question.
Badrouchi et al. (2025) studied Acute myocardial infarction complicated by left ventricular systolic dysfunction or pulmonary congestion (n=5,661). Auto-MACE (AI-based adjudication system combining OpenAI o1-mini and Clinical Longformer) vs. Human physician Clinical Events Committee (CEC) adjudication was evaluated on Estimated treatment effect of sacubitril/valsartan versus ramipril on time to first composite MACE (cardiovascular death, nonfatal MI, or nonfatal stroke) under Auto-MACE adjudication (HR 0.91, 95% CI 0.78-1.07). Auto-major cardiovascular events agreed with human CEC in 97% of confident CV deaths, 89% of MIs, and 88% of strokes, yielding a similar composite major cardiovascular events HR for sacubitril/valsartan vs ramipril.
Synapse has enriched 10 related papers. Consider them for comparative context: