Answers are grounded in this paper and cite their sources.
Fine-tuning pre-trained models for remote sensing tasks often demands substantial computational resources. To reduce memory requirements and training costs, this paper proposes a low-memory fine-tuning framework, called efficient side-tuning (EST), for remote sensing downstream tasks. EST attaches a parallel network to the backbone of the model, and only fine-tunes the parameters of the parallel network during the training phase. The proposed EST Block is the main component of the parallel network, which uses the multi-channel adapter fusion module, gate layer and depthwise convolution to achieve feature selection and enhancement effects. In the evaluation, on six remote sensing datasets including object detection and semantic segmentation, EST achieved SOTA performance results using only less than 40% of the memory expenditure of full finetuning, which is better than all current Parameter Efficient FineTuning (PEFT) methods. Additionally, experiments on backbones of various sizes and classes show that the generalizability of EST is also reliable. EST thus offers a highly efficient and effective approach for efficient transfer learning in remote sensing, unlocking new possibilities for advanced remote sensing applications.
No takes yet. Share an insight, caveat, or question.
Yu et al. (2025) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: