Survey reveals key visual generative AI techniques across mixed reality environments, highlighting integrated paradigms for multimodal interaction, controllable generation, and content creation.
GenAI is increasingly reshaping spatial interactions in immersive environments, bridging diverse input and output modalities to create intelligent user experiences. This survey provides a structured examination of visual GenAI techniques adapted and applied to MR contexts, which include Virtual Reality (VR), and Augmented Reality (AR), emphasizing their roles in enabling rich, adaptive, and naturalistic interactions. We screened publications from international venues between 2018 and 2025, followed by an in-depth review of 102 papers. We focus on the applications of visual content creation in 2D&3D and vision-language models (VLMs), highlighting their integration practices within MR. Furthermore, we investigate the co-evolution of generative models and MR interaction design, including immersive visualization, controllable generation, and synthetic data creation. The survey concludes by outlining recent challenges and potential research directions to advance the synergy of visual GenAI and MR techniques.
No takes yet. Share an insight, caveat, or question.
Wang et al. (2026) studied this question.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: