Peer code review is widely used in programming and software engineering education, but its instructional value depends on the quality of student feedback rather than review completion alone. In large classes, instructors can readily monitor participation but lack scalable methods for assessing whether feedback is relevant, concrete, and constructive, limiting opportunities for timely instructional intervention. To address this gap, this study developed and evaluated the Review Engagement Graph (REG), an instructor focused learning analytics dashboard that integrates multilabel artificial intelligence classification of feedback quality with interactive network visualization. REG operationalizes feedback quality across three independent dimensions and translates five recurring visual patterns into corresponding pedagogical actions while preserving instructor judgment. The system was evaluated in two studies. Study 1 compared seven classification models spanning traditional machine learning, deep learning, fine-tuned transformers, and prompted large language models using 2,398 peer review comments independently annotated by two experts. Fine-tuned RoBERTa achieved the strongest overall performance, with a macro F1 score of 0.828. Study 2 evaluated REG with instructors and teaching assistants through scenario-based sessions. REG achieved a mean System Usability Scale score of 81.13, exceeding the benchmark of 68, and a mean perceived usefulness score of 4.31 out of 5. These findings demonstrate that AI classified feedback quality indicators can be transformed into actionable visual evidence through a pattern to action framework that supports timely and informed instructor decision making.
No takes yet. Share an insight, caveat, or question.
Chen et al. (2026) studied this question.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: