Determination of Optional Cutting Scores in Criterion - Referenced Measurement,

An empirical methodology is proposed for determining optimal cutting scores for short-fixed-length criterion-referenced tests. Classification of outcome probabilities and validity coefficient approaches are developed using validation samples of instructed and uninstructed students. The optimal cutting score is selected according to the estimated probabilities of correct and incorrect mastery-nonmastery decisions. These probabilities, along with the gains and losses associated with the decisions, are then incorporated into an index of utility for identifying the cutting score which maximizes test usefulness in specific individual and group decision situations. The practical value of using the test compared to an alternative is also examined in terms of incremental validity.