Reliability Formulas for Independent Decision Data When Reliability Data are Matched

A distinction is made between reliability data and decision data. Each of these sets of data may be matched or independent, depending on whether the same instruments (tests, judges, etc.) are applied to every individual in the group or the instruments to be applied to each individual are selected independently for him. Reliability formulas are developed (for both single observations and for composites of k observations) for the case where reliability data are matched but decision data are independent. Formulas previously reported in the literature are inappropriate for this case.