Answers are grounded in this paper and cite their sources.
Retrieval-augmented generation (RAG) improves the reliability of large language model outputs by grounding generated responses in external evidence. However, the quality of RAG-generated answers depends strongly on the relevance of retrieved evidence, the effectiveness of evidence ranking, and the ability to verify whether generated claims are supported by source documents. This study presents a hybrid retrieval and reranking framework for citation-aware RAG in biomedical and healthcare-related document question answering. The proposed framework uses Amazon Bedrock Knowledge Bases for document ingestion, parsing, chunking, embedding generation, and evidence retrieval. Source PDF documents are stored in Amazon S3, embedded using Amazon Titan Text Embeddings V2, and indexed using Amazon OpenSearch Serverless. A hybrid retrieval strategy is applied to retrieve candidate evidence chunks, followed by reranking to prioritize the most relevant passages before answer generation. The answer-generation stage uses the highest-ranked evidence chunks to produce controlled, evidence-grounded responses, while a separate judge model evaluates each generated factual claim against the retrieved evidence. The framework was evaluated using 150 biomedical natural language processing and healthcare transformer queries. This evaluation was designed as a pilot-scale proof-of-concept study to examine the feasibility of the proposed hybrid retrieval, reranking, answer-generation, and grounding-evaluation workflow. Across the evaluation set, the system retrieved and reranked 3,000 evidence chunks and generated responses from the top-ranked evidence. Claim-level grounding evaluation identified 1,200 factual claims, of which 1,184 were judged to be supported by the retrieved evidence and 16 were classified as unsupported, resulting in an overall grounding accuracy of 98.7%. The results indicate that hybrid retrieval, reranking, conservative prompting, and claim-level grounding evaluation can support reliable evidence-grounded RAG responses when sufficient source evidence is available. The study also highlights the distinction between internal grounding accuracy and strict citation accuracy, motivating future work on explicit sentence-level citation generation and expanded human expert validation.
No takes yet. Share an insight, caveat, or question.
Irany et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: