Why the study?
Blink, yawn, and heart rate changes provide clues regarding mental states such as drowsiness and fatigue, motivating a less complex method to extract these physiological signals from smartphone video streams.
Answers are grounded in this paper and cite their sources.
Multi-channel SOBI using smartphone video streams can simultaneously extract physiological signals like blood volume pulse and eye blinks to detect driver drowsiness.
It is well known that blink, yawn, and heart rate changes give clue about a human's mental state, such as drowsiness and fatigue. In this paper, image sequences, as the raw data, are captured from smart phones which serve as non-contact optical sensors. Video streams containing subject's facial region are analyzed to identify the physiological sources that are mixed in each image. We then propose a method to extract blood volume pulse and eye blink and yawn signals as multiple independent sources simultaneously by multi-channel second-order blind identification (SOBI) without any other sophisticated processing, such as eye and mouth localizations. An overall decision is made by analyzing the separated source signals in parallel to determine the driver's driving state. The robustness of the proposed method is tested under various illumination contexts and a variety of head motion modes. Experiments on 15 subjects show that the multi-channel SOBI presents a promising framework to accurately detect drowsiness by merging multi-physiological information in a less complex way.
No takes yet. Share an insight, caveat, or question.
Zhang et al. (2019) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: