What question did this study set out to answer?

This study aims to evaluate how well large language models perform in answering healthcare delivery questions.

June 12, 2026Health Science ReportsOpen Access

Performance of Large Language Models in Answering Healthcare Delivery Questions: A Quantitative Cross‐Sectional Study

View Full Paper

Ask AI

Bookmark

Authors

MKMohsen KhosraviBirjand University of Medical Sciences ZZZahra ZamaninasabBirjand University of Medical Sciences FKFatemeh KhosraviGuilan University of Medical Sciences

Discussion

Member takes

Implication

Quantitative cross-sectional study assessing large language models' ability to answer healthcare delivery questions, indicating varying performance levels.

Key Points

This study aims to evaluate how well large language models perform in answering healthcare delivery questions.
Administered a validated questionnaire to a sample of LLM-based chatbots, including GPT-4.1-mini and others.
Constructed confusion matrices to analyze and compare performance metrics like sensitivity and specificity.
Calculated key metrics including positive predictive value, negative predictive value, and overall accuracy.
ChatGPT and Perplexity demonstrated perfect sensitivity (1.00) and high overall accuracy of 0.80 in the initial assessment.
Gemini improved to the highest specificity (0.80) in the second round, with overall accuracy reaching 0.93.
Negative predictive values remained perfect (1.00) across all models, indicating reliable identification of negatives.

Cite This Study

Khosravi et al. (2026) studied this question.

synapsesocial.com/papers/6a2ba34a8101cf8926f01f5f https://doi.org/10.1002/hsr2.72634

View Full Paper

Ask AI

Bookmark

Implication

Quantitative cross-sectional study assessing large language models' ability to answer healthcare delivery questions, indicating varying performance levels.

Performance of Large Language Models in Answering Healthcare Delivery Questions: A Quantitative Cross‐Sectional Study

Discussion

Member takes

Implication

Key Points

Cite This Study

Performance of Large Language Models in Answering Healthcare Delivery Questions: A Quantitative Cross‐Sectional Study

Discussion

Member takes

Implication

Key Points

Cite This Study

Also Consider

Also Consider