Scoring and Standard Setting with Standardized Patients

The purpose of this study was to compare the continuous method of scoring a performance test composed of standardized patients with a derivative method that assigned each examinee a dichotomous score and to explore the use of Ang off 's method at the case level with these two scoring methods. Both scoring systems produced reasonable means and distributions of scores. The continuous scores were somewhat more reproducible than the dichotomous scores although neither was very relay?ducible. Pass rates for both scoring systems were appropriately very high and thus the reproducibility of the pass/fail decisions was also high. Regardless of the scoring system, the application of Angoff's method reported in this article has the advantages of efficiency and enhanced credibility to the experts.