Answers are grounded in this paper and cite their sources.
Examines how pointing modalities affect visual search performance in VR, suggesting implications for interaction design.
Gaze-based and hand-based multimodal interactions have emerged as key points of focus in virtual reality (VR) selection research. However, few studies have examined the inevitable visual search phase in target selection, which may influence the performance of gaze-based and hand-based pointing modalities. In this study, thirty participants searched for and selected the targets among distractors using gaze-based and hand-based pointing across two levels of visual information density. The sequential task phases of visual search and pointing-selection were examined, with both task performance and eye movements recorded. The results showed that hand-based pointing outperformed gaze-based pointing, primarily due to the hand modality’s superior performance during the visual search phase. Although both methods relied on the eyes for visual search, they produced different gaze patterns, suggesting that using the eyes as effectors disrupts natural eye behavior and visual processing. These findings provide empirical support and cognitive insight for selecting interaction modalities in VR environments.
No takes yet. Share an insight, caveat, or question.
Wang et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: