Modality effects in human–technology interaction

This paper reviews emerging research on how different interaction modalities influence information processing and behavior when using new technological devices. A conceptual framework of modality effects is proposed which argues that different input (vocal, haptic) and output modalities (audial, visual) can trigger both cognitive and affective processes that alter users' downstream behaviors. For example, information consumed audially from voice technology rather than visually on a screen can enhance both cognitive load (i.e., cognitive process) and one's sense of social presence (i.e., affective process), which ultimately shape the types of choices made through the technology. The work concludes with a discussion of future research directions in this domain.