Answers are grounded in this paper and cite their sources.
Depression is one of the most prevalent mental health disorders that can be addressed using objective computational screening that may be used in conjunction with clinical screening, but should not be used to replace it. The present research proposes a clear multimodal approach combining the acoustic, visual and textual behavioural data of a structured interview. The speech is represented by Mel-frequency cepstral coefficients and COVAREP descriptors, the facial behaviour is represented by constrained local neural fields landmarks and the semantics of the text is represented by BERT embeddings. The standardized training-fold statistics, the fixed weighted feature-level concatenation, the principal component analysis and the L2-regularized Logistic Regression are used to standardize, concatenate, reduce and classify modality specific features. The accuracy when evaluated on the DAIC-WOZ corpus, using a participant-independent, stratified five-fold cross validation was 91.2%, macro-precision 88.5%, macro-recall 90.7%, macro-F1 score 89.5%, specificity 91.7%, depressed-class sensitivity 89.7%, and ROC AUC 0.94. Improvements of unimodal and multimodal representations were found in the ablation analysis, with text proving the most effective representation, and acoustic and facial features adding complementary improvements in the multimodal context. The framework focuses on the aspects of methodological transparency, training-fold leakage control and low-parameter classifiers. External validation must be done prior to clinical use.
No takes yet. Share an insight, caveat, or question.
Kallem et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: