From 3D landscape visualization to environmental simulation: The contribution of sound to the perception of virtual environments

This research investigated the perceptual interaction of combining sound with 3D landscape visualizations. sourced from Google Earth at St. James’s Park, London, UK, showing terrain only,terrain with form or terrain with primarily vegetation were paired with four sound conditions using recordings the park (i.e. ‘no sound’, anthropogenic, mechanical and natural). Perceived realism and preference evaluated using a survey delivered via the Internet and in a controlled laboratory environment (N = 199 total). Analysis using repeated measures ANOVA indicated the interaction of sound and 3D significantly alters environmental perception both positively and negatively. Sounds and that are congruent receive higher realism and preference ratings while the more incongruent combination is, the lower the corresponding ratings. The lowest realism and preference ratings are to visualizations showing terrain only combined with speech. The highest realism ratings overall to visualization with built form combined with speech, and visualizations showing primarily paired with a birdcall. The absolute highest realism rating was for the visualization with vegetation and some built form paired with speech, while the highest preference ratings correspond visualizations showing vegetation paired with birdcall or no sound. Aural-visual data collected the web-based survey was comparable to data collected in the laboratory and overall realism ratings the Google Earth visualizations were low (e.g. below 3 on a 1–5 likert type scale). The results suggest is an opportunity to increase experiential authenticity of 3D landscape visualizations with sound.