Key points are not available for this paper at this time.
The goal of this work is to extend the use of physiological measures of listening effort to interactive conversation. The initial work here investigates variations in head movement, eye gaze, and pupil dilation around conversational state changes during task-based conversations. Here, conversational state changes are defined as the points in time at which speakers start and stop talking. Windows around each of these types of state changes are analyzed for systematic differences of these parameters, which could be indicative of changes in attention and/or differences in speech production versus perception. Additionally, we calculate state change response functions, derived from a multivariate regression that maps from the state changes to the measured parameters and extracted features. The predictive power of these functions is explored, alongside comparisons of various considerations in their derivations. Our findings, based on data collected from 12 sets of interactive conversations taking place in varying levels of noise and simulated hearing loss, offer insight into how physiological responses during complex interactions can be measured and interpreted to infer when and where effort is directed throughout conversation.
Masters et al. (Fri,) studied this question.