Answers are grounded in this paper and cite their sources.
Medical imaging underpins modern diagnosis, yet the interpretation of scans such as brain MRI, chest radiographs, dermoscopic images, and retinal fundus photographs still depends on scarce specialist expertise, and the computational tools that support it are usually built as isolated, single-modality applications. This paper presents a Multi-Modal AI-Based Healthcare Diagnostic and Clinical Decision Support System that brings four imaging modalities into one explainable and knowledge-grounded platform. Uploaded images are standardised and analysed by a pretrained DenseNet121 backbone; Gradient-weighted Class Activation Mapping (Grad-CAM) converts the network’s internal activations into a spatial heatmap from which condition-wise scores and a leading condition are derived. The leading condition then drives a Retrieval-Augmented Generation (RAG) pipeline, built on a ChromaDB vector store with all-MiniLM-L6-v2 sentence embeddings, that returns curated findings, symptoms, and recommended clinical actions rather than freely generated text. Each analysis is logged in SQLite and can be exported as a structured PDF report through a Streamlit interface. The architecture is modular, traceable at every step, and deliberately positioned as decision support rather than a replacement for clinical judgement. We describe the design, implementation, and functional evaluation of the prototype, discuss its limitations, and outline the path toward clinically validated deployment.
No takes yet. Share an insight, caveat, or question.
Mishra et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: