Why the study?
Traditional automatic recognition of human emotions relies on sensors placed on the body, but contactless photoplethysmography signal extraction from facial video footage offers an alternative approach.
Answers are grounded in this paper and cite their sources.
Contactless PPG signal extraction combined with deep learning can effectively classify human emotions based on valence and arousal.
Traditional approaches to automatic recognition of human emotions have traditionally relied on using sensors placed on the body to collect physiological data. However, recent studies have shown that it is possible to estimate heart rate by analyzing changes in RGB color during the cardiac cycle in video footage of human faces. This process, called photoplethysmography (PPG) signal extraction, allows for con- tactless measurement. In this study, a pioneering method is introduced for classifying human emotions using contactless PPG signals. Various techniques for extracting PPG signals were tested on a widely used emo- tional database. For classification, a deep learning architecture combining a 1D convolutional neural network (1DCNN) and a long short-term mem- ory (LSTM) was employed. The method demonstrated excellent perfor- mance in binary classification of valence and arousal when using 5-second signal segmentation. It is important to note that the primary aim of this study is to present a new technique for automatically recognizing emo- tions by utilizing deep learning and contactless sensing of physiological signals.
No takes yet. Share an insight, caveat, or question.
VERMA et al. (2023) studied Human emotions. Contactless PPG signal extraction and deep learning (1DCNN + LSTM) was evaluated on Binary classification of valence and arousal.
Synapse has enriched 8 closely related papers on similar clinical questions. Consider them for comparative context: