PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
October 31, 2025Electronics12 citationsOpen Access

Evaluating Retrieval-Augmented Generation Variants for Clinical Decision Support: Hallucination Mitigation and Secure On-Premises Deployment

View Full Paper
KWKrzysztof Wołk

Key Points

  • Response time improved significantly while ensuring privacy protections with audit trails in the process.
  • The best results for Mean Reciprocal Rank indicated robust retrieval accuracy needed in clinical instances, reinforcing effective practices.
  • Enhanced protocols must be considered to minimize hallucinations and maintain data security across clinical applications.
  • Future work aims to enrich decision-making by incorporating genomics and proteomics data into retrieval-augmented systems.

Abstract

For clinical decision support to work, medical knowledge needs to be easy to find quickly and accurately. Retrieval-Augmented Generation (RAG) systems use big language models and document retrieval to help with diagnostic reasoning, but they could cause hallucinations and have strict privacy rules in healthcare. We tested twelve different types of RAG, such as dense, sparse, hybrid, graph-based, multimodal, self-reflective, adaptive, and security-focused pipelines, on 250 de-identified patient vignettes. We used Precision@5, Mean Reciprocal Rank, nDCG@10, hallucination rate, and latency to see how well the system worked. The best retrieval accuracy (P@5 ≥ 0.68, nDCG@10 ≥ 0.67) was achieved by a Haystack pipeline (DPR + BM25 + cross-encoder) and hybrid fusion (RRF). Self-reflective RAG, on the other hand, lowered hallucinations to 5.8%. Sparse retrieval gave the fastest response (120 ms), but it was not as accurate. We also suggest a single framework for reducing hallucinations that includes retrieval confidence thresholds, chain-of-thought verification, and outside fact-checking. Our findings emphasize pragmatic protocols for the secure implementation of RAG on premises, incorporating encryption, provenance tagging, and audit trails. Future directions encompass the incorporation of clinician feedback and the expansion of multimodal inputs to genomics and proteomics for precision medicine.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Krzysztof Wołk (2025) studied this question.

synapsesocial.com/papers/6903fee5b25c631a4265fe83https://doi.org/10.3390/electronics14214227
Ask AI
Helpful
Bookmark
Share
View Full Paper