Multimodal artificial intelligence (MMAI) integrates and interprets diverse data types, such as images, text, video, and audio, and offers new opportunities for clinical decision support systems (CDSSs). Traditional CDSSs rely on unimodal data, which limits their predictive accuracy and coverage. The incorporation of MMAI holds promise for more accurate diagnosis, treatment optimization, and personalized patients care by synthesizing heterogeneous data sources. This narrative review explores the growing role of MMAI in improving diagnostic sensitivity, personalizing treatment, and improving healthcare delivery through the integration of heterogeneous data sources. It examines the evolution of MMAI technologies, such as large language models, large vision models, vision-language models, and large multimodal models, and their practical applications in clinical settings. The review also addresses key ethical, technical, and infrastructure challenges, such as data quality, model interpretability, bias, and system interoperability. Finally, it provides strategic recommendations for clinicians, researchers, and policy makers to promote responsible adoption of MMAI in healthcare. While recent developments show significant promise, addressing current limitations is essential to fully realize the transformative potential of MMAI in modern medicine.
Ardıç et al. (Thu,) studied this question.