PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
May 18, 2026Cardiology and Therapy0 citationsOpen Access

Concordance of Large Language Model Recommendations with Multidisciplinary Heart Team Decisions in Coronary Revascularization and Aortic Valve Intervention: A Systematic Review and Pooled Analysis

ARArmaun D. RouhiSMShreyas V. MenonYGYazid K. Ghanem

Key Points

  • The study aimed to evaluate how well large language model recommendations align with decisions made by multidisciplinary heart teams in complex cardiac interventions.
  • Conducted a literature search for primary studies analyzing LLM recommendations against heart team decisions.
  • Included studies were quantitatively pooled for overall agreement in decision-making.
  • Performed random-effects meta-analysis to estimate proportions of concordance.
  • LLM-heart team concordance varied from 65% to 82% for coronary revascularization and was 77% for aortic valve intervention.
  • The pooled agreement was found to be 0.73 (95% CI 0.60-0.83) indicating substantial heterogeneity across studies.
  • Misclassifications were noted for older patients, highlighting limitations of LLMs due to outdated evidence and data transparency issues.

Abstract

INTRODUCTION: The multidisciplinary heart team (HT) remains the cornerstone of decision-making for complex cardiovascular disease. Large language models (LLMs) and other generative artificial intelligence models have recently emerged as potential decision support tools across diverse clinical settings. We sought to synthesize current evidence and quantitatively estimate concordance between LLM recommendations and HT decisions. METHODS: A literature search was performed using PubMed, Scopus, and Web of Science for primary studies published between November 2022 and February 2026 that evaluated recommendations by LLMs against multidisciplinary HT decisions. Studies reporting overall agreement were included for quantitative pooling. Random-effects meta-analysis was performed to determine proportion of agreement. RESULTS: Four retrospective concordance studies were included regarding decision-making in coronary revascularization and aortic valve intervention. LLM-HT concordance ranged from 65% to 82% for coronary revascularization and was 77% for aortic valve intervention. In random-effects meta-analysis, the pooled agreement between LLM recommendations and HT decisions was 0.73 (95% CI 0.60-0.83) with substantial heterogeneity. Discordance stemmed from LLM reliance on outdated trial evidence and limited transparency regarding utilized data, with misclassifications observed in cases of octogenarians with aortic stenosis. Detailed prompts generally improved accuracy and reliability of LLM recommendations. CONCLUSION: These preliminary findings suggest LLMs may have potential as adjunctive decision support tools for multidisciplinary HTs. There remains potential for misclassification when patient-specific factors and conflicting guidelines complicate decision-making. Further prospective evaluation across diverse LLMs is essential before clinical deployment can be recommended.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Rouhi et al. (2026) studied this question.

synapsesocial.com/papers/6a0aabf55ba8ef6d83b6fa19https://doi.org/10.1007/s40119-026-00453-9
Ask AI
Helpful
Bookmark
Share
View Full Paper