PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
May 6, 20260 citationsOpen Access

Behavioral Drift Detection in Large Language Models via Causal Entropy Divergence: The KA-LLM Framework

View Full Paper
HKHikmat KarimovRARahid Alekberli

Key Points

  • The research aims to develop a framework for detecting behavioral drift in large language models.
  • Developed a streaming drift detection framework named KA-LLM based on the Karimov–Alekberli model.
  • Monitored four channels of entropy for drift detection: C1, C2, C3, and CB.
  • Validated on a 14-domain simulation over 300 days with various drift events.
  • Achieved a detection rate of 57% with a false positive rate of 0.00 per month.
  • Identified 5 silent multi-domain drift events not detectable by traditional methods.
  • Provided per-domain attribution for drift alerts, which is unique compared to baseline approaches.

Abstract

Large language models (LLMs) deployed in production undergo continuous behavioral drift: fine-tuning, RLHF updates, jailbreak degradation, and distributional shift alter output token distributions in ways that are not captured by periodic benchmark evaluation. We present KA-LLM, the first streaming behavioral drift detection framework for LLMs grounded in the Karimov–Alekberli (KA) thermodynamic framework. KA-LLM monitors four channels computed over the entropy of per-domain output distributions: C1 (domain-level causal entropy deviation), C2 (cross-domain coupling covariance), C3 (calibration residual z-score), and CB (response-pattern correlation break). Each alert carries attribution identifying which domain channel and which drift mechanism triggered detection—a capability absent from all baseline methods. Validation on a 14-domain, 300-day simulation (30 drift events: capability, alignment, calibration, jailbreak, and distributional shift; published MMLU/TruthfulQA statistics as proxy baselines) demonstrates DR=57% with FPR=0.00/month at θ=2.5, matching CUSUM and Isolation Forest on detection rate while uniquely providing per-domain attribution. The C2 coupling channel detects 5 silent multi-domain drift events (alignment tax, coordinated capability shift) where no single domain exceeds the individual threshold—invisibleto all per-domain baselines. This paper is the fifth in the KA Framework series.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Karimov et al. (2026) studied this question.

synapsesocial.com/papers/69fa8ef304f884e66b53149fhttps://doi.org/10.5281/zenodo.20029516
Ask AI
Helpful
Bookmark
Share
View Full Paper