What type of study is this?

September 10, 2025Open Access

Transforming Multimodal Sentiment Analysis and Classification with Fusion-Centric Deep Learning Techniques

VVV VinithaDr. Hari Singh Gour University

Key Points

The Enhanced Multi-modal Spatiotemporal Attention Network achieves 92.28% accuracy in sentiment and emotion prediction.
Extensive experiments on the Multimodal Emotion Lines Dataset confirm the robustness of the proposed approach.
Current methodologies often overlook the importance of text in multimodal sentiment analysis, addressing this gap.
The study highlights the effectiveness of deep learning techniques to integrate and enhance multimodal feature extraction.

Abstract

Multimodal Sentiment Analysis (MSA) has has become an important field of research, integrating information since text, visuals, video, and speech modalities to derive thorough physiological insights. Despite substantial advancements, current methodologies frequently regard various modalities uniformly, neglecting the preeminent impact of text during sentiment analysis and ignoring address of redundant and irrelevant data generated during multimodal fusion. This study proposes the Enhanced Multi-modal spatiotemporal attention network (EMSAN), to integrate key features across modalities designed to develop the robustness and generalization of sentiment and emotion predictionfrom video data. It consists various phases such as multimodal feature extraction, fusion, and detection of sentiment polarityto integrate key features across modalities. Extensive experiments carried out on the publicly available Multimodal Emotion Lines Dataset (MELD) that show that the suggested method performs with an accuracy of 92.28% in capturing complicated sentiment and emotion. The comparison showed that the suggested method worked better than other baseline models, which made it possible to develop sentiment analysis in a number of different multimodal frameworks.

KI fragen

Bookmark

View Full Paper