An analysis of standardised patient checklist errors and their effect on student scores

BACKGROUND: The frequency and nature of standardised patient (SP) recording errors during clinical performance examinations (CPX) have an effect on case scores and ultimately on pass/fail decisions. PURPOSE: To determine the effect of SP recording errors on case scores. METHODS: Standardised patients completed checklists immediately after each encounter. To determine checklist accuracy, multiple reviewers developed a checklist key for each student encounter studied. The total errors, the net errors, the errors of commission and omission and error rates by competency skill were analysed. RESULTS: The frequency of errors in history taking was greater than in physical examination, and the majority of errors were made in the students' favour. Summing the errors of commission and omission decreased the effect of total errors on student scores. CONCLUSIONS: High levels of SP recording accuracy are achievable. When errors occur, the net effect is usually in the students' favour.