Research on Reliability and Validity of Mobile Networks-Based Automated Writing Evaluation

Pigaiwang, an automated writing evaluation (AWE) online platform, has been increasingly applied into English writing scoring in China. This article conducted research to empirically assess the reliability and validity of Pigaiwang under mobile networks. It introduces the background and previous works for AWE. Then, an experiment was implemented to evaluate the reliability and validity of Pigaiwang automated evaluation by comparing with the results of human raters and corpus-based assessment. The results show that Pigaiwang alone is not an adequate aid for English writing evaluation. It suggests that combining Pigaiwang, human raters, and corpus might be a beneficial trial for improving English writing mobile education.