PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
March 21, 20260 citationsOpen Access

Three Laws of Semantic Collapse: NLI as Gradient Descent on an Anchor Energy Landscape

View Full Paper
CPChetan S. PatilGovernment Medical College

Key Points

  • The aim is to explore NLI as a dynamic process rather than a static classification, revealing underlying physical laws.
  • Developed Livnium, a classification system for NLI.
  • Modeled inference as a dynamical process with geometry-aware updates.
  • Trained on the SNLI dataset and evaluated performance.
  • Identified three empirical laws governing the NLI process.
  • Showed that learned updates can match analytical gradients without loss of accuracy.
  • Joint retraining improved consistency and increased neutral recall.

Abstract

We present Livnium, a classification system for Natural Language Inference (NLI) in which inference is modeled as a dynamical process rather than a single forward pass. The hidden state evolves through multiple steps under geometry-aware updates before classification. We discover that the trained system follows three empirical laws:(1) the initial state encodes relational difference,(2) semantic space forms an energy landscape defined by log-sum-exp over cosine similarities to anchor vectors,(3) inference dynamics correspond to gradient descent on this energy. We show that the learned update function can be replaced by an analytical gradient with no loss in accuracy on SNLI. Joint retraining improves consistency between dynamics and classification while increasing neutral recall. This work demonstrates that interpretable physical laws can emerge from trained neural systems.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Chetan S. Patil (2026) studied this question.

synapsesocial.com/papers/69be38596e48c4981c678abdhttps://doi.org/10.5281/zenodo.19092510
Ask AI
Helpful
Bookmark
Share
View Full Paper