PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
February 22, 20260 citationsOpen Access

Testing Coherence: A Dual‑System Method for Evaluating Human and Machine Reasoning

View Full Paper
DBDenis Bailey

Key Points

  • To develop a dual-system method for assessing coherence in both human reasoning and AI models.
  • Introduced a bidirectional evaluation method for human and AI systems.
  • Utilized transformation tests: compression, expansion, boundary, and more.
  • Applied the method to both philosophical texts and AI interpretations.
  • Identified areas needing additional clarification in human arguments.
  • Revealed failure modes in AI models including coherence drift and instability.
  • Established a framework for improving philosophical clarity and assessing AI performance.

Abstract

This paper introduces a bidirectional method for evaluating coherence in both human authored philosophical systems and contemporary AI models. The approach treats coherence as the preservation of structural invariants under transformation, and operationalizes this through a sequence of compression, expansion, boundary, counterexample, reconstruction, and cross domain mapping tests. When applied to a philosophical text, these transformations reveal points where the argument requires additional scaffolding or clarification. When applied to an AI model interpreting the same text, the same transformations expose characteristic model failure modes, including coherence drift, level confusion, over generalization, hallucinated structure, and instability in reconstructing multi step reasoning. The result is a dual system evaluation protocol in which each side—human and machine—functions as a stress test for the other. I argue that this method provides a practical framework for strengthening philosophical clarity, diagnosing conceptual drift, and identifying the limits of statistical reasoning systems. The protocol offers a general tool for philosophical methodology and a complementary benchmark for AI interpretive stability, suggesting that coherence based evaluation can serve as a bridge between human conceptual work and machine reasoning.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Denis Bailey (2026) studied this question.

synapsesocial.com/papers/699a9e2d482488d673cd4ad7https://doi.org/10.5281/zenodo.18716119
Ask AI
Helpful
Bookmark
Share
View Full Paper