PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
October 10, 20250 citationsOpen Access

A Survey of LLM-Based Applications in Programming Education: Balancing Automation and Human Oversight

View Full Paper
GPGriffin PittsAHAnurata Prabha HridiALArun-Balajiee Lekshmi-Narayanan

Key Points

  • Interventions are more effective when human-in-the-loop oversight complements model output.
  • Design patterns in LLM applications reveal the potential for formative feedback and knowledge modeling.
  • Automated approaches may struggle with capturing pedagogical nuances in programming education.
  • Future research should enhance transparency and align LLMs with diverse educational needs.

Abstract

Novice programmers benefit from timely, personalized support that addresses individual learning gaps, yet the availability of instructors and teaching assistants is inherently limited. Large language models (LLMs) present opportunities to scale such support, though their effectiveness depends on how well technical capabilities are aligned with pedagogical goals. This survey synthesizes recent work on LLM applications in programming education across three focal areas: formative code feedback, assessment, and knowledge modeling. We identify recurring design patterns in how these tools are applied and find that interventions are most effective when educator expertise complements model output through human-in-the-loop oversight, scaffolding, and evaluation. Fully automated approaches are often constrained in capturing the pedagogical nuances of programming education, although human-in-the-loop designs and course specific adaptation offer promising directions for future improvement. Future research should focus on improving transparency, strengthening alignment with pedagogy, and developing systems that flexibly adapt to the needs of varied learning contexts.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Pitts et al. (2025) studied this question.

synapsesocial.com/papers/68e865117ef2f04ca37e4dcchttps://doi.org/10.48550/arxiv.2510.03719
Ask AI
Helpful
Bookmark
Share
View Full Paper