PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
April 18, 20261 citations

Proto-Interpretation: The Temporality of Large Language Model Inference

View Full Paper
MRMattias Rost

Key Points

  • To explore how large language models generate meaning through a temporal and dynamic process during inference.
  • Analyzed autoregressive generation in language models.
  • Focused on a minimal ambiguity case to illustrate branch competition.
  • Investigated how each token influences future token generation.
  • Identified the process of proto-interpretation in LLMs.
  • Showed that meaning evolves as a dynamic process rather than a static output.
  • Demonstrated that tokens reshape the future continuation space during inference.

Abstract

We show that autoregressive generation in large language models exhibits a temporal structure: each token is not only conditioned on the past but also reshapes the future continuation space. We call this process proto-interpretation : the probabilistic redistribution across competing continuations through which the model gradually commits to one emerging branch of meaning. Using a minimal ambiguity case, we demonstrate branch competition and sequential commitment during inference. These findings reveal meaning in LLMs as a dynamic, temporally unfolding process, shifting interpretability from static model states to inference-time dynamics.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Mattias Rost (2026) studied this question.

synapsesocial.com/papers/69e31ec840886becb653e660https://doi.org/10.1145/3789666
Ask AI
Helpful
Bookmark
Share
View Full Paper