Answers are grounded in this paper and cite their sources.
Large language models (LLMs) are increasingly used in math education, yet little is known about how persona conditioning reshapes LLM math explanations. We examine 28,000 runs from the Math Education Digital Shadows (MEDS) dataset, spanning 14 LLMs as AI assistants (i.e., vanilla AI) or as human shadows (i.e., personifications). We analyze qualitative mathematics-related responses through textual forma mentis networks, knowledge graphs including word–word syntactic, semantic and emotional associations. We also use a DistilBERT-based classifier to flag five categories of potential logical fallacies. A regex-based check of the PCA responses showed that reassuring language was frequent but model-dependent and was not always flagged as appeal to emotion. Persona conditioning produced model-dependent changes in network size, density, and algebraic connectivity. Aggregated human-shadow responses displayed broader lexical coverage. Answers to easy and medium math questions often had no classifier-flagged fallacies, whereas an anxiety-framed PCA prompt sharply increased appeal-to-emotion and relevance labels, especially in AI-assistant mode. On an 18-item quiz, AI assistants’ accuracy exceeded human shadows’ in 10 out of 14 architectures. Expressed confidence exceeded empirical accuracy in 13 of 14 AI-assistant and 11 of 14 human-shadow conditions, a descriptive gap, not a calibration measure. These results show that (i) cognitive digital shadowing modulates LLM-generated mathematical discourse compared to the vanilla AI assistant case, and (ii) the tested LLMs are not infallible mathematics oracles. No measure here directly assesses the explanations’ mathematical validity or teaching quality.
No takes yet. Share an insight, caveat, or question.
ESPOSITO et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: