Key points are not available for this paper at this time.
The problem of multimodal interaction is discussed. The use of blinking and winking, interpreted as “eye gestures,” is considered. The main aim of this study is to propose a simple method that allows the recognition of the state of the eye: open or closed; and to distinguish between blinking and winking. Wearable technology has been used in the introduced solution. Placing the camera close to the eye allows us to simplify the complicated image analysis. The proposed method works irrespective of the user’s location and his/her gaze direction. Further, the use of infrared radiation limits the influence of external disturbing factors such as lighting conditions and pollution. The new solution is tested in two types of experiments: with 2 × 5000 pictures of open and closed eyes and with a group of 30 participants. The total correctness of the eye state recognition is 99.68% (99.94% for open eyes and 99.42% for closed ones). This result implies that the proposed solution can be effectively applied to real-world scenarios. Two applications are considered. In the first one, blinking recognition allows us to check whether safety glasses are used appropriately. In the second application, the control of mouse keys is replaced with eye gestures interpreted from a winking analysis. The introduced solution allows for effective and correct eye state recognition. The new method of control by eye gestures was accepted by the participants of this study.
Kowalczyk et al. (Sat,) studied this question.