PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
June 30, 20260 citationsOpen Access

The Mathematics of Model Discipline

View Full Paper
MAMiquel Noguer Alonso

Key Points

  • The aim is to establish a mathematical framework for evaluating model discipline, incorporating elements beyond in-sample fit.
  • Developed a model-agnostic framework for assessing various types of models.
  • Proved four structural facts related to model behavior and validation.
  • Conducted numerical illustrations and applied stress tests to real data models.
  • Validated that causal and external validity is determined not just by observational fit.
  • Found a discipline vector influencing deployment regret through optimal-transport bounds.
  • Demonstrated that high predictive accuracy could coexist with problematic linguistic learning and invalid counterfactuals.

Abstract

This paper develops a general mathematical framework for model discipline. A model is disciplined when it is not evaluated only by internal coherence or in-sample empirical fit, but also by its preservation of structure, causal response, information sets, operational constraints, regime behavior, linguistic and semantic invariants, and external transfer. The framework applies to parametric models, statistical learning systems, generative models, agent-based simulators, language models, image generators, social simulators, macroeconomic models, financial time-series models, and synthetic economies. Leontief’s critique of formalism detached from empirical measurement is used only as historical motivation; the framework itself is stated in model-agnostic terms. Beyond the definitions we prove four structural facts. The observational diagnostics are refinements of a single object, the observable path law; causal and external validity are not identified by observational fit, so they must be certified by intervention or invariance rather than estimated from fit; the discipline vector controls deploymentregret through a path-space optimal-transport bound; and information leakage can only inflate measured performance, which is why information validity acts as a gate rather than as one term among many. The resulting criterion is deliberately diagnostic rather than scalar: it records what has been measured, what has been certified, and what remains assumed. This separation is important across domains: high predictive accuracy can coexist with linguistic shortcut learning, contaminated information, infeasible policies, unstable regimes, invalid counterfactual responses, or brittle transfer. These results organize the framework into validation certificates with a precise account of what each score can and cannot certify. A minimal numerical illustration computes the discipline vector on observationally equivalent bivariate systems; real- data macroeconomic and stock-return stress tests show finite-sample observational scoring with uncertainty bands; and a controlled language shortcut stress test shows a non-economic failure mode in which surface fluency and coverage remain high while negation, semantic-role, and order-sensitive inference fail

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Miquel Noguer Alonso (2026) studied this question.

synapsesocial.com/papers/6a435c8c759b888809a52ff7https://doi.org/10.5281/zenodo.20995652
Ask AI
Helpful
Bookmark
Share
View Full Paper