SemAlign3D: Multi-Dataset Point Cloud Segmentation with Learnable Class Prompts and KNN Multi-Scale Attention

Point cloud segmentation is a core technology in remote sensing, enabling the extraction of rich semantic information from complex scenes. Existing methods struggle with semantic inconsistency across multiple heterogeneous datasets in complex urban environments. To address semantic inconsistencies, we propose SemAlign3D, a novel multimodal framework for point cloud segmentation that combines learnable class prompts with a multi-scale feature attention module. We integrate five large-scale datasets (SensatUrban, STPLS3D, WHU3D, SemanticKITTI, Semantic3D) to construct a unified training framework, ensuring label consistency by recalibrating semantic labels. The learnable class prompt mechanism dynamically adapts to dataset-specific semantics, enhancing the semantic consistency across multiple datasets of point cloud segmentation. Additionally, the Multi-scale K-Nearest Neighbor Feature Attention Enhancement module integrates local and global features, improving semantic discriminability in complex scenes. Within a single unified training framework, our method effectively aligns semantic labels from multiple heterogeneous datasets, achieving gains of +1.61% mIoU on WHU3D and +0.98% mIoU on SemanticKITTI. These results demonstrate the effectiveness of our framework in improving semantic consistency and robustness across heterogeneous point cloud datasets.