PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
October 12, 20252 citationsOpen Access

AutoCrit: A Meta-Reasoning Framework for Self-Critique and Iterative Error Correction in LLMChains-of-Thought

View Full Paper
YSYao‐Wen Sang

Key Points

  • AutoCrit improves reasoning accuracy by 12-18% compared to traditional CoT methods, addressing errors effectively.
  • The framework combines self-criticism and feedback to reduce error propagation rates by half, enhancing reliability.
  • AutoCrit's integration of critique mechanisms reveals the importance of proactive consistency checks in reasoning processes.
  • The theoretical analysis supports the robustness of AutoCrit, establishing its efficacy in iterative error correction.

Abstract

Large Language Models (LLMs) have shown im- pressive reasoning abilities with the use of chain-of-thought (CoT) prompting. However, reasoning is still brittle: small errors early on propagate forward to lead to confidently asserted but erroneous conclusions. This paper presents AutoCrit, a meta- reasoning system that incorporates structured self-criticism and iterative error-fixing directly into the CoT procedure. AutoCrit integrates a reasoning agent, a critique agent, and an execution monitor in an active feedback loop to detect and correct in- consistency proactively step by step. On mathematical reasoning benchmarks (GSM8K), commonsense inference (CSQA2), and interactive planning (ALFWorld) benchmarks, AutoCrit achieves accuracy improvements of 12–18% over baseline CoT and reduces error propagation rates by half. Theoretical analysis of AutoCrit as an iterative fixed-point system formally establishes it rigorously and provides error-propagation limits that demon- strate its scalability. This work advances LLM reliability by showing that incorporating critique into reasoning outperforms post-hoc validation, the foundation for future reasoning-intensive applications in AI-assisted decision-making.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Yao‐Wen Sang (2025) studied this question.

synapsesocial.com/papers/68ebc91af2c3e4d8d926e297https://doi.org/10.20944/preprints202510.0587.v1
Ask AI
Helpful
Bookmark
Share
View Full Paper

Also Consider

Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context:

  1. 1Critic-CoT: Boosting the reasoning abilities of large language model via Chain-of-thoughts Critic2024 · 1 citations
  2. 2Double-Checker: Enhancing Reasoning of Slow-Thinking LLMs via Self-Critical Fine-Tuning2025
  3. 3CriticBench: Benchmarking LLMs for Critique-Correct Reasoning2024
  4. 4LLM-ARC: Enhancing LLMs with an Automated Reasoning Critic2024 · 2 citations
  5. 5On the Self-Verification Limitations of Large Language Models on Reasoning and Planning Tasks2024 · 3 citations