Answers are grounded in this paper and cite their sources.
The integration of Large Language Models (LLMs) into social simulation has generated considerable enthusiasm, but also raises substantial methodological and epistemological challenges. This critical review examines the use of LLMs as cognitive or decision-making components of simulated agents from a computational social science perspective. Rather than treating the psychological evaluation of LLMs as separate from simulation mechanics, we argue that their behavioral and epistemic limitations can become systemic vulnerabilities when scaled to multi-agent societies. We first map the rapidly evolving landscape of LLM-driven platforms, ranging from small narrative sandboxes to population-scale and spatially structured simulations. We then develop a unified critical framework for analyzing the Micro-to-Macro Validity Gap: the propagation, nonlinear amplification, or convergent contraction of micro-level limitations—including hallucinations, stochastic inconsistency, representational biases, and alignment effects—into agent-level distortions (such as average persona convergence) and macro-level risks (such as artificial consensus and behavioral homogenization), while exposing evaluators to epistemic vulnerabilities such as the Fluency Fallacy and automation bias. We identify contexts in which LLM-based agents offer genuine operational value, including serious games, participatory environments, and exploratory modeling, while distinguishing these uses from confirmatory research with unconstrained models and precise social forecasting. Finally, we examine theory-driven hybrid architectures that embed LLMs within explicit, mechanistic, and reproducible Agent-Based modeling (ABM) frameworks. We argue that such architectures offer a promising but not sufficient path toward improving epistemic control: their validity depends on multi-level evaluation of environmental dynamics, individual behavior, cross-level interactions, and aggregate outcomes, and they remain vulnerable to the risk of physics washing.
No takes yet. Share an insight, caveat, or question.
Taillandier et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: