Answers are grounded in this paper and cite their sources.
Scoping review examines the effectiveness of transformer-based language models in detecting depression from text data, suggesting implications for psychiatric practice.
Depression is a substantial public health issue, with global ramifications. Transformer-Based Language Models (TBLM), with their ability to capture nuanced emotional and semantic information, are particularly well-suited for identifying depressive states from such unstructured textual data. The objective of this scoping review is to examine the usefulness of TBLM in detecting depression on text-based data. This study is based on a comprehensive search of Web of Science Core Collection, which includes studies that focused on the application of TBLM in diagnosing and classifying depression through social media texts. Our findings indicate that models such as BERT and its variants predominate in the existing literature, due to BERT’s demonstrated generalizability in natural language understanding and its capacity to capture semantic and affective features in social media texts. However, generative models like GPT are rarely exploring. Twitter was the most frequently used data source, attributed to its public accessibility, real-time content generation, and large user base. Domain-adapted models, including MentalBERT and RedditBERT, demonstrate promising capabilities through fine-tuning on mental health-related corpora, potentially enhancing the detection of context-specific linguistic cues. This study further suggests that TBLM are increasingly being incorporated into psychiatric practice, with evidence of rapid advancements and encouraging outcomes.
No takes yet. Share an insight, caveat, or question.
Mao et al. (2025) studied this question.
Synapse has enriched 8 closely related papers on similar clinical questions. Consider them for comparative context: