PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
March 29, 2026Scientific Reports1 citationsOpen Access

Low-data cross-modal adaptation for remote sensing with proxy-enhanced multi-granularity feature caching

View Full Paper
YSYong SunQCQijin ChengWXWeijian Xie

Key Points

  • The aim is to improve recognition in remote sensing using a new low-data cross-modal adaptation framework.
  • Developed an LLM-augmented prompt module for better textual representations.
  • Implemented a proxy-enhanced semantic calibration mechanism for visual proxy generation.
  • Created a multi-granularity feature cache for retrieving diverse image features during inference.
  • Evaluated performance in few-shot scenarios against benchmark datasets.
  • The proposed framework shows stable performance in low-data environments.
  • Outperformed existing cross-modal adaptation methods on multiple benchmark datasets.
  • Demonstrated improved semantic grounding and feature alignment compared to traditional approaches.

Abstract

Despite the potential of vision-language models for open-vocabulary recognition, their deployment in remote sensing is limited by the limited effectiveness of generic prompts, the scarcity of annotated datasets, and insufficient domain-specific feature discriminability. To address these limitations, we propose a proxy-enhanced multi-granularity feature caching adaptation framework for cross-modal remote sensing imagery under low-data settings. The proposed architecture integrates three interdependent mechanisms. (1) An LLM-augmented prompt module transforms generic class labels into descriptive attribute sets, such as spatial patterns and spectral characteristics, thereby providing the vision encoder with more informative textual representations. (2) A proxy-enhanced semantic calibration mechanism constructs class-level visual proxies within the frozen visual embedding space, enabling reliable pseudo-label support set generation and improved semantic alignment under limited supervision. (3) A multi-granularity feature cache stores both patch-level texture features and scene-level topological representations. During inference, the cached features are retrieved and combined with zero-shot CLIP predictions, thereby reducing the semantic gap between image and text modalities in remote sensing. The integration of these components strengthens semantic grounding through LLM-augmented prompts and proxy-based support sets, while feature caching and proxy calibration mitigate domain-specific representation gaps. The proposed framework exhibits stable performance in few-shot scenarios where conventional fine-tuning approaches fail to converge. Extensive evaluations on multiple benchmark datasets show that our method outperforms existing cross-modal adaptation approaches.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Sun et al. (2026) studied this question.

synapsesocial.com/papers/69c8c384de0f0f753b39e5abhttps://doi.org/10.1038/s41598-026-39823-7
Ask AI
Helpful
Bookmark
Share
View Full Paper