Psychological Empowerment on the Streets: Designing and Validating Multisensory Experiences in Simulated Autonomous Driving

Driving is evolving from a transportation task into a rich, multisensory experience in automated vehicles. This study developed and evaluated three multisensory solutions combining music with synchronized vibrotactile stimulation for autonomous driving contexts: safe (city driving), engagement (highway cruising), and entertainment (highway entry). Eighteen healthy adult drivers experienced three context-solution pairs presented in music only (M) and music with vibration (MV) modalities with simulated autonomous driving scenarios. Participants' responses were measured using self-assessment manikin (SAM) ratings and electroencephalography (EEG). A significant main effect of modality showed that MV led to greater pleasure than M (EEG: p < 0.05; SAM: p < 0.05), with arousal showing a similar pattern (EEG: p < 0.05; SAM: p = 0.099). Behavioral data showed different emotional profiles across the three context-solution pairs (p < 0.001 for pleasure, arousal, and dominance), whereas the EEG contrast, which subtracted the video-only condition, showed no significant pair effect. These findings demonstrate that vibrotactile enhancement provides consistent emotional benefits across diverse driving contexts. Because each musical solution was paired with a unique driving scenario, these differences cannot be attributed solely to the music intervention. Future optimization of music and vibrotactile parameters may further enhance the autonomous driving experience.