PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
April 28, 2026Pattern Recognition0 citationsOpen Access

ATDFusion: Adapter-Tuned Dual-Branch Network for multimodal medical image fusion

View Full Paper
CLChenyang LiJilin UniversityRZRui ZhuHZHongyun ZhaoStanford University

Key Points

  • This work aims to develop a network that effectively fuses multimodal medical images while preserving diagnostic details.
  • Developed ATDFusion, a dual-branch network combining global semantic and detail branches.
  • Introduced a Low-Rank Dynamic Token Adapter for effective fine-tuning of pretrained models.
  • Implemented a Fusion Enhancement Guidance module with saliency-aware loss for spatial supervision.
  • ATDFusion improved SSIM and CC by 11.93% and 5.07% respectively on MRI-CT, MRI-PET, and MRI-SPECT tasks.
  • Achieved leading results in EN and PSNR metrics, validating the proposed model's effectiveness.
  • Demonstrated strong zero-shot generalization on the unseen HECKTOR 2025 dataset.

Abstract

Multimodal medical image fusion aims to combine complementary visual information from different imaging modalities to assist diagnosis and clinical decision-making. Existing methods often struggle to balance global semantic representation and local detail preservation, leading to blurred or incomplete features in salient regions. This work proposes ATDFusion (Adapter-Tuned Dual-Branch Network), featuring a global semantic branch and an auxiliary detail branch to jointly capture high-level context and fine-grained details. A Low-Rank Dynamic Token Adapter (LR-DTA) adaptively fine-tunes intermediate layers of pretrained models based on token number and rank. Additionally, a Fusion Enhancement Guidance (FEG) module imposes explicit spatial supervision via a saliency-aware loss to strictly preserve diagnostically critical regions. On three typical tasks (MRI-CT, MRI-PET, MRI-SPECT), ATDFusion surpasses state-of-the-art methods, improving SSIM and CC by 11.93% and 5.07%, respectively. Other metrics (e.g., EN, PSNR) also achieve leading results, validating its effectiveness. Furthermore, the model demonstrates strong zero-shot generalization on the unseen HECKTOR 2025 dataset. Code is available at https://github.com/pluto628/ATDFusion . • Asymmetric dual-branch framework resolves the semantic-detail trade-off. • Low-Rank Dynamic Token Adapter realizes efficient sample-specific fine-tuning. • Explicit spatial supervision guarantees the retention of metabolic/anatomical hotspots. • Achieves SOTA performance with strong zero-shot generalization on unseen datasets.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Li et al. (2026) studied this question.

synapsesocial.com/papers/69f04e5b727298f751e724b1https://doi.org/10.1016/j.patcog.2026.113848
Ask AI
Helpful
Bookmark
Share
View Full Paper