Answers are grounded in this paper and cite their sources.
Hyperspectral–multispectral image fusion (HMIF) aims to achieve hyperspectral image (HSI) super-resolution by integrating the rich spectral information of HSI with the high spatial resolution of multispectral image (MSI). Despite remarkable progress enabled by deep learning, HMIF remains challenging. Conventional fusion networks that rely solely on feature concatenation often fail in leveraging the abundant prior knowledge inherent in remote sensing data, thereby limiting their ability to simulate the complex nonlinear relationships found in real-world scenes. Moreover, introducing shallow cross-modal feature sharing frequently results in edge artifacts or spectral distortions, while adopting decoupled branches hinders propagating complementary information across different modalities. To address these limitations, we propose spatial–spectral cross-modal alternating direction method of multipliers (ADMM) unfolding network (SCIAU-Net), an explainable deep learning framework that unfolds the optimization process of the ADMM. SCIAU-Net reformulates two degradation models dominated by HSI and MSI, respectively, into a dual-branch neural architecture with dedicated modules designed to solve the corresponding variables. To begin with, dense VRWKV block (DVB) replace handcrafted components, embedding domain knowledge and physical priors of remote sensing images directly into the network. Moreover, we introduce spatial–spectral cross-modal interaction modules. In the HSI-dominated branch, SpeCIM injects MSI-guided spatial cues via adaptive implicit neural representation to extract spatial details, while in the MSI-dominated branch, SpaCIM employs state space duality to model intergroup spectral dependencies and refine spectral reconstruction. Finally, a principled loss function—comprising a mean squared error term and a Karush–Kuhn–Tucker-consistency term—penalizes the ADMM primal and dual residuals, promoting convergence toward physically consistent solutions. Extensive qualitative and quantitative experiments on five datasets demonstrate that SCIAU-Net achieves state-of-the-art performance in all evaluated scenarios, producing high-resolution HSI with superior spatial and spectral fidelity.
No takes yet. Share an insight, caveat, or question.
Zhang et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: