Answers are grounded in this paper and cite their sources.
This paper first reviews recent research on evaluating second language learners’writing skills. It then discusses research on a categorical instrument for evaluating compositions written by upper intermediate university ESL students. The form of the instrument used in this study included five equally weighted criteria for scoring: (1) Organization, (2) Logical Development of Ideas, (3) Grammar, (4) Mechanics, and (5) Style. An experiment was conducted under controlled conditions in which ten raters scored fifty randomly selected compositions. Regression analysis and generalizability theory were used for investigating the reliability of the instrument. In addition, information was obtained from the raters as to their reactions to the instrument. The results indicate that the scoring instrument is moderately reliable. More useful, perhaps, is the demonstration provided of the effects on reliability of changing the number of raters and/or criteria. The paper concludes with a discussion of the issues involved (both with this particular instrument and with analytic scoring systems in general) and of possible future research on the evaluation of nonnative speakers’writing.
No takes yet. Share an insight, caveat, or question.
Brown et al. (1984) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: