PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
September 10, 2025IEEE Journal of Biomedical and Health Informatics2 citations

MedMAP: Promoting Incomplete Multi-modal Brain Tumor Segmentation with Alignment

View Full Paper
TLTianyi LiuUNSW SydneyZTZhaorui TanUniversity of LiverpoolMCMuyin ChenXi’an Jiaotong-Liverpool University

Key Points

  • The proposed approach ensures invariant feature representations, addressing limited performance from missing modalities.
  • Our methodology shows superior performance across multiple datasets, including BraTS2018 and BraTS2020.
  • Knowledge distillation and domain adaptation are applied to enhance segmentation effectiveness with missing MRI data.
  • Extensive experiments validate that aligning latent features leads to narrowed modality gaps during segmentation.

Abstract

Brain tumor segmentation is often based on multiple magnetic resonance imaging (MRI). However, in clinical practice, certain modalities of MRI may be missing, which presents a more difficult scenario. To cope with this challenge, Knowledge Distillation, Domain Adaption, and Shared Latent Space have emerged as commonly promising strategies. However, recent efforts to address the missing modality problem in brain tumor segmentation typically overlook the modality gaps and thus fail to learn important invariant feature representations across different modalities. Such drawback consequently leads to limited performance for missing modality models. To ameliorate these problems, pre-trained models are used in natural visual segmentation tasks to minimize the gaps. However, promising pre-trained models are difficult to obtain in the brain tumor segmentation task due to the lack of sufficient data. Along this line, in this paper, we propose a novel paradigm that aligns latent features of involved modalities to a well-defined distribution anchor as the substitution of the pre-trained model. As a major contribution, we prove that our novel training paradigm ensures a tight evidence lower bound, thus theoretically certifying its effectiveness. Extensive experiments on different backbones validate that the proposed paradigm can enable invariant feature representations and produce models with narrowed modality gaps. Models with our alignment paradigm show their superior performance on both BraTS2018, BraTS2020 and Brain Metastasis datasets. Code is available at https://github.com/T-Y-Liu/MedMAP.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Liu et al. (2025) studied this question.

synapsesocial.com/papers/68c1cc3754b1d3bfb60f46f7https://doi.org/10.1109/jbhi.2025.3600496
Ask AI
Helpful
Bookmark
Share
View Full Paper