Answers are grounded in this paper and cite their sources.
This study investigates the effects of voice and gesture interaction with in-vehicle robots on driving performance, workload, and user experience using multimodal physiological measures. A 2 (driving environment: simple vs. complex) × 3 (interaction modality: none, voice, gesture) within-subject simulated driving experiment was conducted. Eye-tracking, functional near-infrared spectroscopy (fNIRS), and electrocardiography (ECG) were used to record physiological responses. The results indicate that complex driving environments significantly increase cognitive and physiological demands, as reflected in higher workload, heart rate and pupil diameter, along with reduced blink frequency. The no-interaction condition was associated with lower driving workload and better driving performance. In complex environments, interaction tasks also increased ΔHbO in the dorsolateral prefrontal cortex (DLPFC). Although subjective evaluations favoured voice over gesture interaction, no significant differences were observed in physiological measures, whereas gesture interaction resulted in greater gaze diversion. These findings highlight the value of multimodal physiological measures for evaluating human-vehicle interaction.
No takes yet. Share an insight, caveat, or question.
Ren et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: