This study aimed to evaluate the levels of student acceptance and effectiveness of an AI-powered chatbot platform as a teaching tool in the undergraduate oral medicine and pathology curriculum compared to traditional teaching methods. Oral medicine and pathology case scenarios were developed with prompt engineering techniques on the GPT-4-powered CognitusAI web-based platform (Med2Lab), which utilised both a virtual patient and a virtual preceptor in conducting each case. The first phase of the study involved pilot testing to assess 50 students’ levels of acceptance of the platform and gather suggestions for improvement. The second phase was a comparative study, with 40 students in the intervention group undergoing case-based learning on the CognitusAI platform, and 40 in the control group undergoing a traditional tutorial of the same scenarios. The students took pre- and post-intervention assessments to evaluate knowledge levels. 92% of students felt confident to apply the knowledge gained on the platform, and 86% stated that it encouraged them to understand. Over 80% of students were more aware of their progress and areas for improvement after the module, and over 90% were interested in similar learning opportunities in the future. Students felt that the platform’s advantages included its strong clinical relevance, facilitation of active recall, personalised and non-judgemental feedback, and good engagement and interactiveness. In the comparative study, students in both the intervention and control groups showed significant score improvements after the teaching session ( p < 0.001 for both). Although the difference in score improvements between the intervention and control group was not statistically significant ( p = 0.062), the intervention group had significantly higher post-intervention test scores ( p = 0.041) and a higher proportion of students with improved scores ( p < 0.001). AI-powered chatbot platforms are well-received teaching tools and are equally effective and potentially superior to traditional teaching methods in enhancing students’ knowledge and understanding in oral medicine and pathology.
Quah et al. (Sat,) studied this question.