PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
May 29, 2026Remote Sensing0 citationsOpen Access

Hyperspectral and Multispectral Image Fusion Based on Adaptive Wavelet Transform and Dual Spectral–Spatial Branch

View Full Paper
YCYanhui ChangZXZhiyun XiaoJLJiayang Lu

Key Points

  • To develop an advanced image fusion technique that effectively combines hyperspectral and multispectral images using adaptive wavelet transform and deep learning.
  • Proposed a deep learning fusion module combining pixel-wise adaptive wavelet transform and dual spectral–spatial extraction.
  • Employed Multi-Scale Group Convolution module and Spectral Compression and Spatially Guided Gating Module for feature extraction.
  • Introduced a bidirectional attention mechanism to improve information capture across scales.
  • Achieved superior performance in image reconstruction compared to over ten state-of-the-art fusion methods.
  • Successfully preserved spectral information and enhanced spatial edge features during the fusion process.

Abstract

As the role of remote sensing continues to grow, the fusion technology of low-spatial-resolution hyperspectral images and high-spatial-resolution multispectral images has become increasingly critical. Traditional methods rely on fixed rules and exhibit poor robustness, whereas deep learning methods struggle to establish efficient interactions between local and global information due to the complexity of their underlying networks. Therefore, we propose a deep learning fusion module that combines pixel-wise adaptive wavelet transform with a spectral–spatial dual-branch extraction. Firstly, by utilizing the unique properties of the wavelet transform, it is possible to effectively preserve spectral information and extract spatial edge features, thereby achieving preliminary fusion by leveraging both low-frequency and high-frequency components. To compensate for the lack of nonlinear expression capability in the wavelet transform, a dual-branch parallel extraction of spectral and spatial features is subsequently performed in the deep learning module. The Multi-Scale Group Convolution module (MSGC) is utilized to extract spectral information, while the Spectral Compression and Spatially Guided Gating Module (SCSGM) is employed to extract spatial information, thereby enhancing the data’s adaptive capability. A bidirectional attention mechanism is interspersed within the module to capture complementary information across different scales, ultimately reconstructing a high-resolution hyperspectral image. Finally, the proposed fusion strategy demonstrates superior performance in practical image reconstruction, outperforming more than ten state-of-the-art fusion methods.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Chang et al. (2026) studied this question.

synapsesocial.com/papers/6a192eb9fab5b468c4417fa4https://doi.org/10.3390/rs18111726
Ask AI
Helpful
Bookmark
Share
View Full Paper