PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
January 26, 20260 citationsOpen Access

Stable Semantics in Large Language Models: A Geometric Perspective on Inference and Reasoning

View Full Paper
HCHIDEYUKI CHINO

Key Points

  • This research aims to understand semantic instability and hallucination in large language models through a geometric framework.
  • Conducted a structural and geometric analysis of LLMs.
  • Framed hallucination as a dynamical phenomenon.
  • Examined inference trajectories in high-dimensional spaces.
  • Identified semantic instability as a breakdown of contraction properties.
  • Described hallucination as a state transition in LLMs.
  • Highlighted how trajectories can escape stable basins.

Abstract

This paper presents a structural and geometric analysis of semantic instability and hallucination behavior in large language models (LLMs). Rather than treating hallucination as a factual error or post-hoc failure, this work frames it as a dynamical phenomenon: a loss of semantic stability arising from the geometry of inference trajectories in high-dimensional representation space. Hallucination is analyzed as a state transition in which contraction properties break down and semantic trajectories escape stable basins. The paper builds on earlier works but is distinct in scope and audience. While the earlier series focused on general computational and physical convergence principles, specifically targets LLM architectures and the conditions under which coherent dialogue becomes unstable. This manuscript is currently under review at the Journal of Machine Learning Research (JMLR). The version archived here is provided as a public preprint to facilitate discussion, citation, and cross-disciplinary exchange.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

HIDEYUKI CHINO (2026) studied this question.

synapsesocial.com/papers/697703af722626c4468e8b9chttps://doi.org/10.5281/zenodo.18357911
Ask AI
Helpful
Bookmark
Share
View Full Paper