Answers are grounded in this paper and cite their sources.
Demonstrates effective automatic depression assessment in varied modalities, suggesting enhanced accuracy through multi-modal graph representation.
Automatic depression assessment (ADA) often relies on crucial cues embedded in human verbal and non-verbal behaviours, which exists in video, audio, and text modalities. Although these modalities frequently show in time-series forms, current research offers limited exploration of the complex intramodal temporal dynamics inherent to each modality, failing to extract the depression-related cues in a global view. While many methodologies attempt to exploit the multifaceted information encoded across modalities via decision-level or feature-level fusion techniques, they often fall short in effectively representing pairwise inter-modal relationships, which is the key to utilize the distinct complementary relationship between each modality pair. This paper presents a novel graph-based multi-modal fusion approach, which can model intra-modal and inter-modal dynamics conveniently using a graph representation. It adopts undirected edges to link not only temporally continuous, preextracted features of each modality, but also temporally aligned features across each pair of modalities. This ensures the seamless propagation of global information across temporal dimensions and helps capture the pairwise inter-modal dynamics.We conduct experiments on the E-DAIC dataset to validate the effectiveness of our approach, with an RMSE of 4.99 and a CCC value of 0.628, which rival the top-performing method. We also experiment on the AFAR-BSFP dataset to show the generality of our approach. Our code will be made publicly available.
No takes yet. Share an insight, caveat, or question.
Wu et al. (2026) studied this question.
Synapse has enriched 8 closely related papers on similar clinical questions. Consider them for comparative context: