Answers are grounded in this paper and cite their sources.
Guidelines for professional degree theses require automatically generated feedback that is both linguistically accurate and consistent with program-specific structural, methodological, and regulatory requirements. This study developed a retrieval-augmented educational artificial intelligence system that assigns confidence scores to four thesis types, retrieves type-specific normative requirements, and applies a confidence boundary mechanism to select single-type or dual-type feedback. A controlled pilot experiment compared four system variants on 50 expert-annotated Education Master’s theses: a baseline large language model, a prompt-enhanced variant, a retrieval-augmented variant, and the full system that adds the confidence boundary mechanism to retrieval. Under a strict unique-primary-label rule, the baseline and the prompt-enhanced variant reached 64.0 % and 46.0 % accuracy, respectively. The independently executed retrieval-augmented variant and the full system reached 80.0 % and 82.0 %, and this paired difference was not statistically significant. A routing-only paired reanalysis that reused the same confidence scores returned 82.0 % accuracy with the boundary mechanism both disabled and enabled, confirming that the mechanism governs feedback routing rather than the choice of the top-ranked thesis type. With the mechanism enabled, boundary detection reached 90.0 % precision, 87.1 % recall, and an F1-score of 88.5 %. Complete dual-type coverage was 61.3 %, and partial candidate coverage reached 87.1 %. Stratified-bootstrap confidence intervals and macro-averaged scores were reported to reflect the small, imbalanced sample. The results indicate that retrieval grounding supports the assignment of a primary thesis type, whereas boundary-aware routing reduces overconfident single-type guidance for ambiguous thesis topics.
No takes yet. Share an insight, caveat, or question.
Chao Zhang (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: