Large Language Models suffer from hallucination, generating plausible yet factually incorrect content. Current mitigation strategies focus on post-generation correction, which is computationally expensive and fails to prevent unreliable content generation. We propose a confidence-aware routing system that proactively assesses model uncertainty before generation and redirects queries based on estimated reliability. Our approach combines three complementary signals: semantic alignment between internal representations and reference embeddings, internal convergence analysis across model layers, and learned confidence estimation. The unified confidence score determines routing to four pathways: local generation for high confidence, retrieval-augmented generation for medium confidence, larger models for low confidence, and human review for very low confidence. Evaluation on knowledge-intensive QA benchmarks demonstrates significant improvements in hallucination detection (0.74 vs. 0.42 baseline) while reducing computational costs by 40% compared to post-hoc methods. The F1 score improves from 0.61 to 0.82 with low false positive rates (0.09). This paradigm shift from reactive correction to proactive assessment offers a computationally efficient approach to LLM reliability enhancement.
Building similarity graph...
Analyzing shared references across papers
Loading...
M Nandakishor
Building similarity graph...
Analyzing shared references across papers
Loading...
M Nandakishor (Tue,) studied this question.
www.synapsesocial.com/papers/68e25382d6d66a53c24748b9 — DOI: https://doi.org/10.48550/arxiv.2510.01237
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: