Answers are grounded in this paper and cite their sources.
The expressive exploration of sonic spaces is a frequent mechanism of Digital Musical Instruments. These spaces can consist in sets of sounds, sonified data, interpolated synthesis presets and so on. Performers, whether novices or experts, might find it difficult to navigate such spaces due to their complexity and diversity. Extended Reality technologies enable the addition of visual elements over the physical space, providing visual feedback on the sonic space using colours, shapes or visual metaphors. However, it can be challenging to display the information without visual overload and while preserving the focus on musical gestures. In this article, we investigate different types of visualisations for the exploration of sonic spaces in Mixed Reality. We use drawing as an interaction metaphor, with strokes as a visual representation of a sonic trajectory. After evaluating various feedback options in a study with expert musical and visual artists, we conduct a controlled experiment with 18 novice users. The task was to reproduce sequences of sounds inside a sonic space by doing trajectories, while testing out different visualisation levels directly onto the strokes. The results did not reveal a statistically significant effect of the visualisations on the trajectories’ accuracy (with only anecdotal evidence for an absence of difference). However, participants preferred having higher levels of visualisation to guide them in their sonic exploration.
No takes yet. Share an insight, caveat, or question.
Gruy et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: