PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
October 8, 20250 citationsOpen Access

iDPA: Instance Decoupled Prompt Attention for Incremental Medical Object Detection

View Full Paper
HYHuahui YiWXWei XuZQZiyuan Qin

Key Points

  • Results indicate a performance improvement of 5.44% in full data for incremental medical object detection tasks.
  • Framework integrates instance-level prompt generation and decoupled prompt attention, addressing key challenges in medical imaging.
  • Experiments evaluate on 13 clinical, cross-modal, multi-organ datasets, emphasizing its versatility and effectiveness.
  • The approach effectively mitigates catastrophic forgetting while maintaining efficiency in memory usage.

Abstract

Existing prompt-based approaches have demonstrated impressive performance in continual learning, leveraging pre-trained large-scale models for classification tasks; however, the tight coupling between foreground-background information and the coupled attention between prompts and image-text tokens present significant challenges in incremental medical object detection tasks, due to the conceptual gap between medical and natural domains. To overcome these challenges, we introduce the ~framework, which comprises two main components: 1) Instance-level Prompt Generation (), which decouples fine-grained instance-level knowledge from images and generates prompts that focus on dense predictions, and 2) Decoupled Prompt Attention (), which decouples the original prompt attention, enabling a more direct and efficient transfer of prompt information while reducing memory usage and mitigating catastrophic forgetting. We collect 13 clinical, cross-modal, multi-organ, and multi-category datasets, referred to as, and experiments demonstrate that ~outperforms existing SOTA methods, with FAP improvements of 5. 44\%, 4. 83\%, 12. 88\%, and 4. 59\% in full data, 1-shot, 10-shot, and 50-shot settings, respectively.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Yi et al. (2025) studied this question.

synapsesocial.com/papers/68e6d7971ffa7aa7d63d1743https://doi.org/10.48550/arxiv.2506.00406
Ask AI
Helpful
Bookmark
Share
View Full Paper