The extent to which writing modality (i.e., hand-writing vs. keyboarding) impacts second-language (L2) writing assessment scores remains unclear. For alphabetic languages like English, research shows mixed results, documenting both equivalent and divergent scores between typed and handwritten tests (e.g., Barkaoui Liao, 2023; Zhang Zhu et al., 2016), and advanced proficiency groups. This study examined whether this scoring differential exists at the intermediate level. Writing samples were collected from 60 intermediate-level university L2 Chinese learners (N = 120), with counter-balanced prompts and modalities. Two certified raters used a three-criterion analytic rubric for scoring. A linear mixed-effects model showed that regardless of modality or prompt order, test takers produced more content and achieved higher scores on typed responses, even when controlling for language proficiency, multilingual experiences, and Chinese writing/typing habits. These findings suggest that handwritten and typed L2 Chinese test tasks may assess different constructs, carrying implications for various assessment contexts (classroom assessment, placement testing, proficiency tests) and assessment research.
Matthew D. Coss (Sat,) studied this question.