Answers are grounded in this paper and cite their sources.
AI tutors powered by Retrieval-Augmented Generation (RAG) are increasingly used in education, but their reliability depends on retrieving appropriate instructional content. This study quantifies RAG performance in an educational setting using benchmarks of varying complexity derived from a biotechnology curriculum. We began with a baseline RAG system evaluated on a manually constructed question–answer benchmark, then introduced automated benchmark generation to scale evaluation across RAG configurations and identify the most impactful design choices. We further evaluated the best-performing configuration on textbook-section benchmarks labeled by Bloom's Taxonomy and Webb's Depth of Knowledge. Results show that architectural choices such as retrieval strategy and chunking were associated with larger performance differences than parameter-level adjustments, with Milvus hybrid retrieval achieving higher success rates than Pinecone dense retrieval in this benchmark. Full-textbook retrieval also improved performance on some higher-difficulty questions compared to section-limited search. Together, these findings underscore the importance of systematically evaluating retrieval reliability for AI tutors in complex biotechnology domains.
No takes yet. Share an insight, caveat, or question.
Jamiluddin et al. (2026) studied this question.
Synapse has enriched 8 closely related papers on similar clinical questions. Consider them for comparative context: