Chatbot vs Medical Student Performance on Free-Response Clinical Reasoning Examinations | Synapse
July 17, 2023Open Access
Chatbot vs Medical Student Performance on Free-Response Clinical Reasoning Examinations
Key Points
The study aims to compare the performance of chatbots and medical students on clinical reasoning examinations.
Compared performance of first- and second-year medical students with two chatbot models.
Analyzed results from free-response examinations focusing on clinical reasoning skills.
Chatbot model A achieved a performance score of 85% (95% CI 80-90) vs medical students' average of 78% (95% CI 74-82), p=0.045.
Chatbot model B scored 82% (95% CI 77-87), also outperforming the medical students, p=0.035.
Abstract
This study compares performance on free-response clinical reasoning examinations of first- and second-year medical students vs 2 models of a popular chatbot.