Answers are grounded in this paper and cite their sources.
The results from this study describe relatively low reliability in the WBAs obtained across seven sites. Generalisability for these instruments may be less dependent on factors such as faculty development, rater engagement or scale selection. When used for formative feedback, data from these instruments may be useful. However, such instruments do not consistently provide reasonable reliability to justify their use in high-stakes summative entrustment decisions.
No takes yet. Share an insight, caveat, or question.
Ryan et al. (2024) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: