PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
April 3, 2026BMC Psychiatry3 citationsOpen Access

Retrieval‑augmented large language models for depression screening and suicide risk stratification

WXWenbo XieXSXulai SongZLZerui Lu

Key Points

  • The research aims to improve depression screening and suicide risk stratification using a Retrieval-Augmented Generation framework with large language models.
  • Developed a RAG framework integrating large language models and a clinical knowledge base for depression and suicidality.
  • Evaluated three leading Chinese LLMs under base and RAG-augmented settings.
  • Assessed model performance on multi-source datasets focusing on diagnostic outputs and quality measures.
  • Qwen3 + RAG achieved an F1-score of 0.9107 for depression detection.
  • RAG improved suicide risk stratification F1-scores by approximately 0.15 versus non-RAG models.
  • High reproducibility in both depression diagnosis and suicide risk classification was demonstrated (overall κ = 0.93).

Abstract

Depression imposes substantial individual and societal burdens, yet more than 80% of cases remain undetected in non‑psychiatric settings, and approximately 15% of individuals with severe depression die by suicide. Existing screening methods are limited by subjective self‑report, fragmented care pathways, and stigma‑related underutilization. We developed and locally deployed a Retrieval‑Augmented Generation (RAG) framework that integrates large language models (LLMs) with an evidence‑based clinical knowledge base for depression and suicidality. Three leading Chinese LLMs (DeepSeek, Qwen, Baichuan) were evaluated under base and RAG‑augmented configurations. The knowledge base comprised clinical practice guidelines, standard textbooks, and peer‑reviewed literature. Model performance was assessed on multi‑source datasets. Outcomes included classification of depression and suicide risk, consistency of diagnostic outputs, symptom‑summary quality, and clinician‑rated empathy and dialogue quality. RAG augmentation consistently improved diagnostic performance across datasets. For depression detection, Qwen3 + RAG achieved an F1‑score of 0.9107, and for suicide risk stratification, RAG enhanced F1‑scores by approximately 0.15 compared with non‑RAG baselines. The best‑performing configuration demonstrated high reproducibility for both depression diagnosis and suicide risk classification (overall κ = 0.93; 95% CI: 0.91–0.95). Symptom summarization was substantially improved with RAG, with relative gains of 44.1–207.2% in BLEU‑2 and 37.0–94.0% in ROUGE‑L. Clinician‑blinded ratings indicated clinician-evaluated high-level empathic expression in RAG‑enhanced models (mean scores 4.23–4.98/5), with Qwen3 + RAG exhibiting particularly strong emotional concordance (95% CI: 4.80–4.92). Dialogue quality was rated as high across domains, including fluency (mean 4.98/5) and perceived doctor‑likeness (mean 4.94/5). A domain‑specific, RAG‑enhanced LLM framework can deliver clinically reliable, reproducible, and empathetic depression screening and suicide risk stratification in both real‑world and simulated settings. Local on‑premises deployment supports privacy and data‑governance requirements, while the scalable architecture and structured outputs position this approach as a promising tool for augmenting mental health triage and longitudinal monitoring in resource‑constrained environments.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Xie et al. (2026) studied this question.

synapsesocial.com/papers/69cf59315a333a8214609da6https://doi.org/10.1186/s12888-026-07988-0
Ask AI
Helpful
Bookmark
Share
View Full Paper