The rapid adoption of generative artificial intelligence tools such as ChatGPT in educational settings has generated both enthusiasm and concern regarding their influence on student learning. While several studies report improvements in efficiency, confidence, and perceived understanding, evidence for durable conceptual learning and knowledge transfer remains mixed. This article examines these tensions through the concept of fluency illusion, a cognitive phenomenon in which information that is easy to process is mistakenly judged as being well understood. Using a narrative conceptual review approach, this study synthesizes findings from 41 publications identified through searches of Google Scholar, Scopus, Web of Science, and ERIC covering the period from 2022 to early 2026. The reviewed literature includes 28 empirical studies, nine conceptual or theoretical analyses, and four review articles addressing the use of ChatGPT in educational contexts. Across domains such as writing and language learning, STEM problem solving, feedback and tutoring, and assessment, the literature shows a recurring pattern in which fluent AI-generated responses increase learners’ confidence without consistently improving deeper conceptual understanding. Drawing on research from cognitive psychology and metacognition, this review proposes an integrative conceptual account of how fluent AI output may shape learners’ judgments of understanding and influence their engagement with learning tasks. The paper concludes by discussing implications for instructional design, assessment practices, and metacognitive scaffolding, and outlines directions for future research aimed at empirically examining the proposed framework and identifying strategies to reduce fluency-driven misjudgments while preserving the potential benefits of generative AI in education.
Kumar et al. (Thu,) studied this question.