PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
August 30, 20241 citationsOpen Access

Adaptive Control of Retrieval-Augmented Generation for LLMs Through Reflective Tags

View Full Paper
CYChengyuan YangSFSatoshi Fujita

Key Points

Key points are not available for this paper at this time.

Abstract

While Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs), it also presents challenges that can affect model accuracy and performance. Practical applications show that RAG can mask the intrinsic capabilities of LLMs. Firstly, LLMs may become overly dependent on external retrieval, underutilizing their own knowledge and inference abilities, which can reduce responsiveness. Secondly, RAG techniques might introduce irrelevant or low-quality information, adding noise to the LLM. This can disrupt the normal generation process, leading to inefficient and low-quality content, especially when dealing with complex problems. This paper proposes a RAG framework that uses reflective tags to control retrieval. This framework evaluates retrieved documents in parallel and incorporates the Chain of Thought (CoT) technique for step-by-step content generation. The model selects the highest quality and most accurate content for final generation. The main contributions include: 1) Reducing the hallucination problem by selectively utilizing high-scoring document, 2) Enhancing real-time performance through timely external database retrieval, and 3) Minimizing negative impacts by filtering out irrelevant or unreliable information through parallel content generation and reflective tagging. These advancements aim to optimize the integration of retrieval mechanisms with LLMs, ensuring high-quality and reliable outputs.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Yang et al. (2024) studied this question.

synapsesocial.com/papers/68e5a3f3b6db64358753e10dhttps://doi.org/10.20944/preprints202408.2152.v1
Ask AI
Helpful
Bookmark
Share
View Full Paper

Also Consider

Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context:

  1. 1Large Language Models are Zero-Shot Reasoners2022 · 1,118 citations
  2. 2Selection-Inference: Exploiting Large Language Models for Interpretable Logical Reasoning2022 · 110 citations
  3. 3Large Language Models Can Be Easily Distracted by Irrelevant Context2023 · 106 citations
  4. 4Multimodal Chain-of-Thought Reasoning in Language Models2023 · 100 citations
  5. 5KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answering2021 · 26 citations