ChatGPT can assist medical educators in drafting course content and assessment questions, but it is prone to providing incorrect information and is not yet suitable as a reliable information resource.
ChatGPT can assist medical educators in drafting content and questions but requires expert oversight due to its propensity to provide factually incorrect medical information.
Abstract Objective To explore the use of ChatGPT by educators and students in a medical school setting. Method This study used the public version of ChatGPT launched by OpenAI on November 30, 2022 ( https://openai.com/blog/chatgpt/ ). We employed prompts to ask ChatGPT to 1) generate a content outline for a session on the topics of cholesterol, lipoproteins, and hyperlipidemia for medical students; 2) produce a list of learning objectives for the session; and 3) write assessment questions with and without clinical vignettes related to the identified learning objectives. We assessed the responses by ChatGPT for accuracy and reliability to determine the potential of the chatbot as an aid to educators and as a “know-it-all” medical information provider for students. Results ChatGPT can function as an aid to educators, but it is not yet suitable as a reliable information resource for educators and medical students. Conclusion ChatGPT can be a useful tool to assist medical educators draft course and session content outlines and create assessment questions. At the same time, caution must be taken as ChatGPT is prone to providing incorrect information; expert oversight and caution are necessary to ensure the information generated is accurate and beneficial to students. Therefore, it is premature for medical students to use the current version of ChatGPT as a “know-it-all” information provider. In the future, medical educators should work with programming experts to explore and grow the full potential of AI in medical education.
Han et al. (Tue,) conducted a other in Medical Education. ChatGPT was evaluated. ChatGPT can assist medical educators in drafting course content and assessment questions, but it is prone to providing incorrect information and is not yet suitable as a reliable information resource.