PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
June 20, 2026ACM Transactions on Multimedia Computing Communications and Applications0 citations

Reliability-Aware Multi-View Fusion for Robust Multimodal Sarcasm Detection with Incomplete Observations

View Full Paper
HGHao GuoSHSubin HuangJCJunjie Chen

Key Points

  • This research aims to improve sarcasm detection by developing a method that handles incomplete multimodal observations effectively.
  • Proposed Reliability-Aware Dynamic Fusion (RADF) module for assessing the reliability of text and images.
  • Utilized temperature-scaled softmax for dynamic fusion weight adjustment based on reliability scores.
  • Evaluated the effectiveness of the approach using extensive experiments on public datasets.
  • The approach outperforms existing baselines in sarcasm detection accuracy.
  • Demonstrated effective handling of incomplete multimodal data, enhancing prediction reliability.
  • Achieved significant improvements in feature extraction and fusion compared to traditional methods.

Abstract

Multimodal sarcasm detection identifies ironic intent by jointly analyzing text and images. It has attracted increasing attention due to its importance in understanding user-generated content on social media. However, multimodal observations are often incomplete due to data loss during transmission or collection, leading to unreliable predictions in real-world multimodal sarcasm detection scenarios. To address incomplete observations, we further propose a Reliability-Aware Dynamic Fusion (RADF) module, which predicts the reliability of the textual, visual, and interactive views from their representations, converts these reliability scores into dynamic fusion weights via a temperature-scaled softmax to control the sharpness of the weight distribution, and refines the fused features through feature-wise scaling. In this way, degraded views are suppressed while more informative views are emphasized under incomplete observations. Extensive experiments on public datasets validate the effectiveness of our approach, which consistently outperforms existing baselines.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Guo et al. (2026) studied this question.

synapsesocial.com/papers/6a363147db0793dc1a538390https://doi.org/10.1145/3820382
Ask AI
Helpful
Bookmark
Share
View Full Paper