PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
August 16, 2026Sensors0 citationsOpen Access

MDCFT-HSM: Modality-Shift-Aware RGB-T Small-Object Detection for Low-Altitude UAV Remote Sensing

View Full Paper
TLTianchen LongYWYanwen WangHYHezhuo Yuan

Key Points

  • To develop an ordered feature-flow framework, MDCFT-HSM, that addresses unequal modality reliability and feature attenuation for small-object detection in low-altitude UAV RGB-T imaging.
  • Designed a protected primary feature branch combined with zero-initialized residual mappings at stem, P3, P4, and P5 stages to curb degraded auxiliary modality interference.
  • Integrated High–Low Frequency Detail Enhancement (HLFDE), Selective Boundary-Guided Aggregation (SBGA), and Multi-scale Guided Feature Recalibration (MGFR) modules into the detection network.
  • Evaluated performance, inference efficiency, and robustness against modality absence and spatial misalignment on the RGBTDronePerson and DroneVehicle datasets.
  • Achieved 49.53% mAP@0.5 and 18.97% mAP@0.5:0.95 with 7.38 M parameters, 44.2 GFLOPs, and 60.0 FPS on RGBTDronePerson.
  • Reached 83.60% mAP@0.5 and 63.28% mAP@0.5:0.95 on the DroneVehicle benchmark dataset.
  • Demonstrated robustness to auxiliary RGB absence and mild cross-modal spatial misalignment, while showing vulnerability to severe infrared degradation and larger spatial offsets.

Abstract

Low-altitude UAV RGB-T small-object detection is challenged by unequal modality reliability and the progressive attenuation of small-object evidence. To address these issues, this paper proposes Modality-Dominant Controlled Fine-Tuning with Hierarchical Small-Object Modeling (MDCFT-HSM), an ordered feature-flow framework for RGB-T detection. Based on dataset-level single-modality performance, MDCFT selects an initial protected branch and introduces auxiliary-modality information through zero-initialized residual mappings at the stem, P3, P4, and P5 stages, thereby limiting interference from degraded auxiliary features. Within this controlled feature flow, the High–Low Frequency Detail Enhancement module (HLFDE) preserves shallow boundary, texture, and local thermal-response cues; the Selective Boundary-Guided Aggregation module (SBGA) strengthens cross-level detail propagation in the neck; and the Multi-scale Guided Feature Recalibration module (MGFR) recalibrates the P3, P4, and P5 features before the Detect head. On RGBTDronePerson, MDCFT-HSM achieves 49.53% mAP@0.5 and 18.97% mAP@0.5:0.95 with 7.38 M parameters, 44.2 GFLOPs, and an inference speed of 60.0 FPS. On DroneVehicle, it achieves 83.60% mAP@0.5 and 63.28% mAP@0.5:0.95. Controlled robustness tests show limited tolerance to auxiliary RGB absence and mild cross-modal spatial misalignment, whereas severe IR degradation, IR absence, and larger spatial offsets cause substantial performance loss. These results demonstrate a competitive accuracy–complexity trade-off under a fixed dataset-level protected-branch configuration. The method does not provide online sample-level reliability adaptation or geometric registration.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Long et al. (2026) studied this question.

synapsesocial.com/papers/6a817a21f2fb91fc834adbabhttps://doi.org/10.3390/s26165146
Ask AI
Helpful
Bookmark
Share
View Full Paper

Also Consider

Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context:

  1. 1DuAT: Dual-Aggregation Transformer Network for Medical Image Segmentation2023 · 178 citations
  2. 2Improving Multispectral Pedestrian Detection by Addressing Modality Imbalance Problems2020 · 287 citations
  3. 3SLBAF-Net: Super-Lightweight bimodal adaptive fusion network for UAV detection in low recognition environment2023 · 68 citations
  4. 4Drone-based RGBT tiny person detection2023 · 73 citations
  5. 5A Progressive Target-Aware Network for Drone-Based Person Detection Using RGB-T Images2025 · 6 citations