PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
September 28, 2025npj Digital Medicine21 citationsOpen Access

Multimodal foundation model and benchmark for comprehensive retinal OCT image analysis

View Full Paper
JMJosé MoranoBFBotond FazekasESEmese Sükei

Key Points

  • MIRAGE outperformed existing models in segmentation and classification tasks for OCT and SLO images, highlighting its effectiveness.
  • It achieved superior results compared to general and specialized foundation models, validating its robustness.
  • Assessment involved comprehensive analysis across both classification and segmentation tasks related to ophthalmic images.
  • This model may enable significant advancements in AI applications for retinal imaging, enhancing clinical outcomes.

Abstract

Abstract Artificial intelligence (AI) has become a fundamental tool for assisting clinicians in analyzing ophthalmic images, such as optical coherence tomography (OCT). However, developing AI models often requires extensive annotation, and existing models tend to underperform on independent, unseen data. Foundation models (FMs), large AI models trained on vast, unlabeled datasets, have shown promise in overcoming these challenges. Nonetheless, available FMs for ophthalmology lack extensive validation, especially for segmentation tasks, and focus on a single imaging modality. In this context, we propose MIRAGE, a novel multimodal FM for the analysis of OCT and scanning laser ophthalmoscopy (SLO) images. Additionally, we propose a new evaluation benchmark with OCT/SLO classification and segmentation tasks. The comparison with general and specialized FMs and segmentation methods shows the superiority of MIRAGE in both types of tasks, highlighting its suitability as a basis for the development of robust AI systems for retinal OCT image analysis.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Morano et al. (2025) studied this question.

synapsesocial.com/papers/68d913ab4ddcf71ba560bc31https://doi.org/10.1038/s41746-025-01852-3
Ask AI
Helpful
Bookmark
Share
View Full Paper