If a test is constructed of testlets, one must take into account the within‐testlet structure in the calculation of test statistics. Failing to do so may yield serious biases in the estimation of such statistics as reliability. We demonstrate how to calculate the reliability of a testlet‐based test. We show that traditional reliabilities calculated on two reading comprehension tests constructed of four testlets are substantial overestimates.
No takes yet. Share an insight, caveat, or question.
Sireci et al. (1991) studied this question.
Synapse has enriched 3 closely related papers on similar clinical questions. Consider them for comparative context: