What question did this study set out to answer?

This study aims to evaluate the psychometric performance and student perceptions of AI-generated versus student-generated multiple-choice questions (MCQs).

June 19, 2026BMC Medical EducationOpen Access

Psychometric performance and student perceptions of AI- versus student-generated multiple-choice questions: a single-center randomized controlled trial

View Full Paper

Ask AI

Bookmark

Authors

DADheyaa Al-NajafiUniversity of British Columbia KKKatherine D. KrauseUniversity of British Columbia YWYue WangUniversity of Stuttgart

Discussion

Member takes

Implication

Randomized trial compares psychometric performance of AI and student-generated MCQs in first-year medical students, highlighting potential efficiencies and acceptability.

Key Points

This study aims to evaluate the psychometric performance and student perceptions of AI-generated versus student-generated multiple-choice questions (MCQs).
Participant-blinded, parallel-group randomized controlled trial among first-year medical students.
Students completed a 112-item case-based mock examination composed of either AI-generated or student-generated MCQs.
Outcomes were assessed using Van der Vleuten's Assessment Utility Framework across various dimensions.
AI-generated MCQs demonstrated a 5.6-fold efficiency gain compared with student-generated items (4.2 vs. 19.6 min per item; p < 0.0001).
Student perceptions regarding exam clarity, difficulty, relevance, and educational value were comparable between AI and student-generated exams (all p ≥ 0.12).
Slightly higher discrimination indices were observed for student-generated items, but the effect size was small.

Cite This Study

Al-Najafi et al. (2026) studied this question.

synapsesocial.com/papers/6a34dc0f65a5b0777af2c7de https://doi.org/10.1186/s12909-026-09671-0

View Full Paper

Ask AI

Bookmark

Implication

Randomized trial compares psychometric performance of AI and student-generated MCQs in first-year medical students, highlighting potential efficiencies and acceptability.

Psychometric performance and student perceptions of AI- versus student-generated multiple-choice questions: a single-center randomized controlled trial

Discussion

Member takes

Implication

Key Points

Cite This Study

Psychometric performance and student perceptions of AI- versus student-generated multiple-choice questions: a single-center randomized controlled trial

Discussion

Member takes

Implication

Key Points

Cite This Study

Also Consider

Also Consider