The purpose of this study was to investigate the interrater reliability of proficiency level judgments of graduate student trainee raters on Oral Proficiency Interviews (OPIs). Trainees' ratings were compared with the judgments of a certified ACTFL tester for 150 interviews. In addition to reporting correlation coefficients, this study analyzes the relationship between proficiency level and its effect on interrater reliability. The data indicate that Superior and Intermediate Mid interviews resulted in the highest level of interrater reliability, while Advanced High, Advanced, and Intermediate High interviews were more difficult for the trainee raters to judge.
No takes yet. Share an insight, caveat, or question.
Gene B. Halleck (1996) studied this question.
Synapse has enriched 5 related papers. Consider them for comparative context: