PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
June 17, 2026Sensors0 citationsOpen Access

SIM-PCSR: Key-Layer Complementary Enhancement for UAV RGB-IR Small-Object Detection

View Full Paper
JHJun HeYYYi YangJLJun Li

Key Points

  • The aim is to enhance detection of small objects using UAV RGB-IR imaging by addressing challenges in cross-modal fusion.
  • Developed SIM-PCSR for enhanced detection efficiency.
  • Utilized DroneVehicle dataset with performance metrics like mean average precision.
  • Conducted module ablation and qualitative visualization for validation.
  • Achieved 85.323 mean average precision (mAP)50, improving baseline by 0.523%, P<0.001.
  • Obtained 63.572 mAP50:95, with a 1.20% improvement over baseline.
  • Experimental validation supports effectiveness of selective modal interaction.

Abstract

Unmanned aerial vehicle (UAV) red–green–blue–infrared (RGB-IR) object detection is important for traffic monitoring, security surveillance, and urban management, but remains challenging because aerial targets are often small, densely distributed, and affected by complex backgrounds. In addition, RGB and infrared (IR) modalities contribute unequally under different imaging conditions, making simple feature concatenation or indiscriminate middle-layer fusion insufficient for stable cross-modal utilization. To address this problem, this paper proposes Selective Interaction Mechanism and Prefiltering Complementary Spatial Refinement (SIM-PCSR), a key-layer complementary enhancement method for UAV RGB-IR small-object detection. The proposed method decomposes cross-modal modeling into two stages. SIMAdapter first performs selective interaction on the small-object-sensitive P3 layer before fusion, suppressing redundant responses and enhancing potentially complementary modal evidence. PCSR then refines the fused representation through prefiltering, modal selection, and local window residual refinement, injecting reliable complementary information into the key-layer fused feature in a controlled manner. Experiments on the DroneVehicle dataset show that SIM-PCSR achieves 85.323 mean average precision (mAP)50 and 63.572 mAP50:95, improving the Fixed Middle Fusion baseline by 0.523 and 0.751 percentage points, respectively. These gains correspond to relative improvements of 0.62% and 1.20% over the baseline. Module ablation, position ablation, repeated-seed evaluation, category-wise analysis, scale-wise analysis, and qualitative visualization jointly demonstrate that explicit selection and organization of cross-modal information can improve UAV RGB-IR small-object detection under modality imbalance and background interference.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

He et al. (2026) studied this question.

synapsesocial.com/papers/6a323cc9d50b63ecad206c7fhttps://doi.org/10.3390/s26123806
Ask AI
Helpful
Bookmark
Share
View Full Paper