Answers are grounded in this paper and cite their sources.
It is sometimes assumed that large language models (LLMs) know language, or for example that they know that Paris is the capital of France. But what—if anything—do LLMs actually know? In this paper, I argue that LLMs can acquire tacit knowledge as defined by Martin Davies (1990). Whereas Davies himself denies that neural networks can acquire tacit knowledge, I demonstrate that certain architectural features of LLMs satisfy the constraints of semantic description, syntactic structure, and causal systematicity. Thus, tacit knowledge may serve as a conceptual framework for describing, explaining, and intervening on LLMs and their behavior.
No takes yet. Share an insight, caveat, or question.
Céline Budding (2025) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: