EyesWeb: Toward Gesture and Affect Recognition in Interactive Dance and Music Systems

This paper presents the EyesWeb project. The goal of the EyesWeb project is to develop a modular system for the real-time analysis of body movement and gesture. Such information can be used to control and generate sound, music, and visual media, and to control actuators (e.g., robots). Another goal of the project is to explore and develop of interaction by extending music language toward gesture and visual languages, with a particular focus on the understanding of affect and expressive content in gesture.