Answers are grounded in this paper and cite their sources.
A double trial assesses problem-solving MCQs for non-English speaking medical students, suggesting improved assessment methods.
Background: There have been several attempts at finding out the most valid way of assessing the outcome of teaching.The long essays gave way to multiple choice questions (MCQ) which later were scrapped in favor of short structured questions.Multiple choice questions had many problems like cueing and very straight forward way of framing questions.Use of clinical vignettes and application of knowledge made MCQs a powerful tool to assess associative learning.Clinical competence could thus be evaluated using scenario based questions.Objectives: To determine whether a vignette or scenario based problem solving approach in MCQs will lower or improve the scores of students.Design: A double trial of MCQs with old and new pattern questions.Setting: A medical school in the middle-east.Subjects: Non-English speaking population of students.Methods: Two tests were conducted for 85 students one with straight forward questions and answers and a second one with vignette based and scenario based questions.Double negatives or other confusing ways of asking questions were avoided.Item analysis was conducted for both exams.Item facility index, modified caution index, point biserial index and discrimination index were worked out for each question and averaged for each examination.Results: While seventeen students did better on the vignette dominant examination, majority could not handle this examination very well.The overall score was significantly lower with vignette dominant examination.MCQs were found to differentiate the good and bad students in terms of discrimination index.Our study pointed out the weakness of students in applying the knowledge.We had the problem of a non-English speaking population of students faced with Americanized questions.At the same time it was evident that writing skills of such students needed to be improved.This aspect was never tested with the use of MCQs.Conclusions: MCQs are more efficient, reliable and valid provided problem-solving type of questions which work at a cognitive level without perusing too much of vignettes for a non-English speaking population are used.
No takes yet. Share an insight, caveat, or question.
A et al. (2011) studied this question.
Synapse has enriched 8 closely related papers on similar clinical questions. Consider them for comparative context: