PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
March 12, 2026Drones1 citationsOpen Access

Semantic-Guided Matching of Heterogeneous UAV Imagery and Mobile LiDAR Data Using Deep Learning and Graph Neural Networks

TTTee‐Ann TeoHYHao YuPCPei-Cheng Chen

Key Points

  • The research aims to improve the geometric registration between UAV imagery and LiDAR data using semantic features.
  • Developed a semantic feature matching framework for UAV and LiDAR data.
  • Used YOLOv11 for semantic segmentation of road markings in UAV and LiDAR images.
  • Applied SuperPoint detector and SuperGlue matcher for establishing correspondence points.
  • Transformed cross-sensor alignment into a two-dimensional image matching problem.
  • The semantic-guided strategy outperformed traditional feature-based matching methods.
  • Semantic constraints effectively reduced false matches between geometrically similar objects.
  • Complex geometric features, such as pedestrian crossings, yielded the most accurate matching.

Abstract

The integration of heterogeneous geospatial data, specifically low-cost unmanned aerial vehicle (UAV) imagery and mobile light detection and ranging (LiDAR) system point clouds, presents a significant challenge due to the significant radiometric and structural discrepancies between the two modalities. This study proposes a novel air-to-ground semantic feature matching framework to achieve precise geometric registration between these data sources by effectively incorporating semantic-constraint deep learning-based matching. The methodology transformed the cross-sensor alignment challenge into a robust two-dimensional image matching problem. This was achieved by first using YOLOv11 for semantic segmentation of common road markings in both the UAV orthoimage and the converted LiDAR intensity image to generate highly consistent feature references. Subsequently, the SuperPoint detector and a graph neural network matcher, SuperGlue, were applied to these semantic images to establish reliable geomatics information correspondence points. Experimental results confirmed that this semantic-guided strategy consistently outperformed traditional feature-based matching (i.e., scale-invariant feature transform + fast library for approximate nearest neighbors), particularly by converting the noisy LiDAR intensity image into a stabilized semantic representation. The explicit application of semantic constraints further proved effective in eliminating false matches between geometrically similar but semantically distinct objects. The final object-specific analysis demonstrated that features with clear, complex geometric structures (e.g., pedestrian crossings and directional arrows) provide the most robust matching control. In summary, the proposed framework successfully leverages semantic context to overcome cross-sensor heterogeneity, offering an automated and precise solution for the geometric alignment of mobile LiDAR data.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Teo et al. (2026) studied this question.

synapsesocial.com/papers/69b2588496eeacc4fcec83e9https://doi.org/10.3390/drones10030185
Ask AI
Helpful
Bookmark
Share
View Full Paper