Integrated Fusion Network for Hyperspectral, Multispectral and Panchromatic Data Fusion

The fusion of traditional HSI mainly involves the fusion of HSI with MSI or PAN. Nevertheless, the combination of the former is constrained by the inadequate spatial resolution of MSI, and therefore the enhancement of the spatial resolution of HSI is inadequate. The latter is constrained by the substantial disparity in spectral information between PAN and HSI, leading to pronounced distortion of high-resolution HSI. To address this issue, this paper proposes IFNPMH, which is an integrated fusion network for used for the fusion of HSI, MSI, and PAN. The IFNPMH algorithm is capable of efficiently extracting spatial information from MSI and PAN, as well as spectral information from HSI. It combines the spatial and spectral information to produce fused images that possess precise spectral information and distinct spatial details. Specifically, IFNPMH incorporates the CBAM attention mechanism module to enhance feature representation capabilities. Finally, this article proposes a loss function that combines spectral and spatial information loss in IFNPMH training. The effectiveness of the proposed IFNPMH is demonstrated by extensive testing in comparison to other sophisticated approaches. This model has shown promising performance in terms of qualitative visual effects and quantitative evaluation metrics.