Answers are grounded in this paper and cite their sources.
Most existing multimodal fusion methods adopt a symmetric fusion strategy to optimize feature consistency between modalities. However, this strategy ignores modality specific discrepancies, and its equal weight distribution mechanism exacerbates the class imbalance problem, resulting in poor classification performance for small-sample categories such as “road”. To address these issues, this study proposes a Category Aware Asymmetric Dynamic Fusion Network (CADFNet), which realizes cross-modal differentiated feature interaction guided by class-level information through the synergy of a Multi-Level Dif ference Pyramid Fusion Module (MDPF) and a Dynamic Sparse Category Attention Module (DSCA). The MDPF module fully mines and enhances cross-modal complementary information by explicitly modeling multi-scale differential features to address the problem of insufficient utilization of modal difference features in existing methods; The DSCA module uses a dynamic sparsity mechanism in conjunction with semantic perception to adaptively assign modal weights to different categories, achieving refined alignment and fusion of cross-modal key areas, thereby effectively alleviating the class imbalance problem. Comprehensive experiments on the PIE-RGB-SAR and WHU-OPT-SAR datasets demonstrate that CADFNet achieves excellent performance. In particular, on the WHU-OPT-SAR dataset, its mean Intersection over Union (mIoU) shows improvements ranging from 1.99% to 15.32% over other state-of-the-art methods.
No takes yet. Share an insight, caveat, or question.
Ye et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: