Multimodal generative AI is rapidly transforming how preliminary diagnosis, triage, and patient guidance can be delivered through intelligent assistants. Unlike traditional symptom checkers or text-only chatbots, contemporary systems blend large language models (LLMs), vision-language models (VLMs), speech recognition/synthesis, retrieval-augmented gener- ation (RAG), and clinical decision support (CDS) logic to provide context-grounded, explainable, and more accessible care experi- ences. This survey synthesizes prior work on multimodal medical chatbots and digital twin concepts, reviews enabling architectures (RAG, knowledge graphs, explainable AI, and privacy-preserving learning), and positions a practical implementation that uses the GROQ API and a built-in multimodal model to accept voice and image inputs and return a voice response and a structured prescription with do’s/don’ts. Building on lessons from digital twin frameworks and multimodal diagnosis assistants, the survey proposes advanced enhancements: longitudinal patient- twin modeling, rationale-guided retrieval, clinical protocol valida- tion, medication-safety checks, bias and uncertainty calibration, and privacy-preserving synthetic data pipelines. The result is a blueprint for a safe, extensible, and clinically aligned medical AI assistant suitable for academic research and eventual clinical piloting
No takes yet. Share an insight, caveat, or question.
Chavan et al. (2025) studied this question.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: