Answers are grounded in this paper and cite their sources.
Depressive disorder has evolved into a major public health issue. However, its diagnosis is predominantly based on subjective clinical evaluation, leading to frequent misdiagnosis. Although multimodal methods have demonstrated potential, they still remain limited in their ability to model long-range temporal dependencies, reconcile semantic heterogeneity across modalities (e.g., facial landmarksvs.gaze behavior), and capture deep inter-modal interactions. To address these challenges, we propose a novel multi-task audiovisual network, termed Bi-CFNet, which is built upon a powerful temporal modeling backbone to capture long-range dependencies and integrates visual enhancement and cross-feedback for depression detection. In addition to the primary binary classification task, we establish a multi-task learning framework to predict item-level clinical scores as an auxiliary task. This design provides supplementary supervisory signals, encouraging the model to learn semantically meaningful representations and mitigate the impact of subjective bias. The visual enhancement module (VEM) employs gated attention to integrate gaze vectors with facial features, yielding temporally aligned and semantically enriched visual representations that are more sensitive to depressive indicators. Furthermore, the cross-feedback mechanism (CFM) facilitates the injection of highlevel semantic features from one modality into the early layers of another, thereby integrating global temporal context into local processing and promoting deep cross-modal re-learning. Finally, extensive experiments on the DAIC-WOZ dataset show that our model achieves an F1-score of 0.85 and a recall of 0.87, surpassing several state-of-the-art trimodal baselines. The proposed framework demonstrates the potential of utilizing audiovisual cues for objective depression analysis, providing a technical foundation for future computer-aided clinical screening systems.
No takes yet. Share an insight, caveat, or question.
Chan et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: