The Reproducibility of Standards Over Groups and Occasions

This article reports two separate studies which examined the reproducibility of absolute standards. Results of the first study indicate that the standards set by independent groups of experts applying the same standard-setting method to the same test material were similar. Results of the second study indicate that the same subset of experts set similar standards for the same test material on a second occasion, considerably later in time. Taken together, these results provide further evidence that a modified version of the Angoff method is quite reliable and produces stable results under varying conditions.