PI-ADFM: Enhancing Multimodal Remote Sensing Image Matching Through Phase-Integrated Aggregated Deep Features

Geometric distortions and significant nonlinear radiometric differences in multi-modal remote sensing images (MRSIs) introduce substantial noise in feature extraction. Single-branch convolutional neural networks fail to capture global image features and integrate local and global information effectively, yielding deep descriptors with low discriminability and limited robustness. Moreover, the lack of comprehensive training data further limits the network's performance, which pose a formidable challenge to existing matching methods in securing adequate and evenly distributed corresponding points. This paper proposes a novel method called Phase-Integrated Aggregated Deep Feature Matching (PI-ADFM), designed to address these challenges. Initially, a phase structure feature detector is introduced, which amalgamates the structural attributes and phase information of images to distill keypoints that are highly repeatable and exhibit minimal redundancy. Subsequently, an attention-based multi-level feature interaction and aggregation module (MFIAM) is crafted to encapsulate a comprehensive representation of both local and global features of keypoints. This is followed by the integration of a dense feature fusion module (DFFM) designed to sift through and amalgamate key features, thereby capturing highly discriminative deep semantic features that serve as descriptors for similarity measures. Finally, a multi-level outlier removal strategy is proposed to effectively reduce mismatches. Experimental results substantiate that, in juxtaposition with state-of-the-art methods, the PI-ADFM method has significantly augmented the count of matches for optical-infrared and optical SAR images by a factor of at least 1.7 and 3.7, respectively, while concurrently enhancing the accuracy by a minimum of 10% and 6%, respectively. These enhancements markedly bolster the robustness and reliability of MRSI matching endeavors. The source code of this study is freely available at https://github.com/hyhqing/PI-ADFM.