Answers are grounded in this paper and cite their sources.
Demonstrates enhanced emotion recognition accuracy in multimodal systems, implying improved human-computer interaction effectiveness.
Multimodal emotion recognition has great application scenarios in the field of human-computer interaction, and the main task lies in how to capture and handle the consistency and complementarity of multimodal signals. However, in numerous scenarios, multimodal fusion is significantly challenged by variances in the strengths and weaknesses of different modality signals in carrying emotional information. This paper aims to learn the essential information of strong modalities and inter-modality correlations thus achieving better emotion recognition. We propose an adaptive multimodal emotion recognition framework based on collaborative discriminative learning (AMCDL), a framework for emotion recognition that engages in collaborative learning and adjusts to the information-processing capabilities of various emotion recognition models. AMCDL calculates the inter-modality correlation using Canonical Correlation Analysis (CCA) and uses it as an influencing factor to boost the multiplicative combination method to create a class loss function. When trained on several modalities, the class loss function can integrate complementary information to enable strong modal expression, enhancing emotion perception. On the benchmark dataset CMU-MOSI, AMCDL significantly improves classification accuracy when compared to the state-of-the-art models. The experiments showed the flexibility and generality of AMCDL by applying several emotion recognition models to it and producing better classification results than the original model.
No takes yet. Share an insight, caveat, or question.
Wang et al. (2023) studied this question.
Synapse has enriched 8 closely related papers on similar clinical questions. Consider them for comparative context: