Contemporary research in Mechanistic Interpretability predominantly characterizes neuronal polysemanticity as an undesirable compression artifact (the Superposition Hypothesis), dedicating vast resources to decomposing neural representations into dictionaries of isolated monosemantic directions using Sparse Autoencoders (SAEs). This position paper presents a foundational architectural counter-thesis: polysemanticity is not a flaw to be eradicated, but the geometric prerequisite for associative intelligence and analogical reasoning. A purely monosemantic neuron possesses zero associative degrees of freedom (relational rank R(u) = 0): devoid of lateral relational pathways, it functions solely as a rigid lookup cell. Conversely, polysemantic units co-activate across isomorphic concepts (e.g., IP Address, DNS, White Pages, Phone Directory) to abstract higher-order structural schemas. The root deficiency in contemporary Large Language Models is not semantic superposition, but the architectural entanglement of fluid reasoning (analogical synthesis) and verification behavior (exact literal retrieval) within homogeneous dense weights. To resolve this dichotomy without resorting to serial bottlenecks or parallel computational duplication (2× FLOPs), I introduce HySA (Hybrid Semantic Architecture): a unified single-substrate paradigm operating in latent Hilbert space. Drawing on operating system heuristics (volatile execution in RAM, rigid data in filesystems via Inodes), HySA governs inference through dual regime temperatures—Polysemantic (T_p) and Monosemantic (T_m)—coupled into the Topological Temperature (T_t), and an internal metric Query API with Intermediate Layer Geometric Gating and Early-Exit. Key Contributions: Failure of Downstream Logit Entropy Gating: I demonstrate why uncertainty heuristics (Shannon entropy on final logits) fail symmetrically on open creative discourse (spurious false-alarm faults) and overconfident hallucinations (silent bypasses). Concentric Geometric Domain Gating (Layer l): Gating is relocated mid-network (Layer 3 in a 6-layer model) using two concentric radii: Domain Radius (R_dom = 0.65) and Topological Temperature (T_t = 0.46). This establishes three distinct regimes: Confirmed Inode Hit (immediate Early-Exit, ~50% FLOPs saved), Semantic Fault (mid-network halt on unindexed factual drift), and Fluid Bypass (unhindered creative generation). Empirical Validation on EleutherAI/pythia-70m: Probing residual stream Layer 3 (D=512) confirms natural polysemantic isomorphism (cosine similarity 0.893–0.973) and demonstrates 100% deterministic precision on indexed technical facts, with clean non-overlapping metric separation across all three operational regimes.
No takes yet. Share an insight, caveat, or question.
Francesco Mariani (2026) studied this question.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: