CSCN: A Cross-Scan Semantic Cluster Network with Scene Coupling Attention for Remote Sensing Segmentation

The spatial attention mechanism has been widely employed in the semantic segmentation of remote sensing images due to its exceptional capacity for modeling long-range dependencies. However, the analysis performance of remote sensing images can be reduced owing to their large intra-class variance and complex spatial structures. The vanilla spatial attention mechanism relies on the dense affine operations and a fixed scanning mechanism, which often introduces a large amount of redundant contextual semantic information and lacks consideration of cross-directional semantic connections. This paper proposes a new Cross-scan Semantic Cluster Network (CSCN) with integrated Semantic Filtering Contextual Cluster (SFCC) and Cross-scan Scene Coupling Attention (CSCA) modules to address these limitations. Specifically, the SFCC is designed to filter redundant information; feature tokens are clustered into semantically related regions, effectively identifying local features and reducing the impact of intra-class variance. CSCA effectively addresses the challenges of complex spatial geographic backgrounds by decomposing scene information into object distributions and global representations, using scene coupling and cross-scanning mechanisms and computing attention from different directions. Combining SFCC and CSCA, CSCN not only effectively segments various geographic spatial objects in complex scenes but also has low model complexity. The experimental results on three benchmark datasets demonstrate the outstanding performance of the attention model generated using this approach.