Augmented virtual reality and 360 spatial visualization for supporting user-engaged design

Abstract This paper discusses an approach to augmented virtual reality (AVR) and 360-degree spatial visualization. The approach involves locating stereoscopic three-dimensional virtual objects into a real off-site panorama, supporting spatial remodel design decision-making through realistic comparisons. Previous studies have shown that in the design process, end-user engagement promotes the quality and satisfaction of design solutions. Immersive media such as virtual reality (VR) and augmented reality (AR) have increasingly been used as communication tools for user engagement in design, as they provide intuitive and realistic user experiences, particularly in comparing design plans. However, the dichotomous affordance of current VR and AR devices is limited in satisfying both the sense of realism and immersion that are essential for user engagement. To overcome this shortcoming, we propose an AVR-based design visualization approach that integrates the advantages of both media technologies to provide a high sense of realism and immersion off-site, responding to location and environmental stimuli, such as lighting, material, and other factors. To achieve this goal, we used 360-degree panorama data of the target space as a design visualization background, with content immersion experienced through VR hardware. Additionally, we developed software to demonstrate the actual use of the AVR-based approach, and various visualization-purposed file formats can be exported automatically using this software. The software supports the authoring of 360-degree spatial visualization videos for realistic design comparisons, which can be easily accessed by end-users using a head-mounted display or smartphone, even in real-time. We performed a demonstration of this approach using an actual remodel design project for the university library lobby, and this paper shows the usability and applicability of the AVR-based approach for user engagement.