Key result
PhyMER dataset provides multimodal physiological signals and personality traits to facilitate emotion recognition.
Why the study?
Because identical stimulus videos often induce different emotions in different individuals, emotion recognition requires considering individual differences such as personality traits.
The PhyMER dataset provides a publicly available multimodal physiological dataset with fine-grained emotion annotations and personality context for developing emotion recognition models.
May advance emotion-aware CV monitoring tools; leaves open validation in clinical cohorts.
Physiological signals are widely used in the recognition of affective status. Recording of such physiological signals involves elicitation of emotions through different stimuli including video-based stimulus. Considering that the same stimulus videos often induce different emotions in different individuals, emotion recognition in such a scenario requires consideration of the individual differences in the consumption of the stimulus content. With this as our goal, we present a Physiological dataset for Multimodal Emotion Recognition (PhyMER) for studying emotion through physiological response with personality as a context. The PhyMER dataset consists of electroencephalogram (EEG), electrodermal activity (EDA), blood volume pulse (BVP), and skin temperature along with the personality traits of 30 participants. We collected the video-based stimulus dataset for emotion elicitation and developed a web-based annotation tool for labeling felt emotions. We compared the stimulus labels and the self-annotation of felt emotions labeled during physiological data recording. Correlation among personalities was analyzed to study the impact of personality on the intensity of emotions in arousal and valence dimensions. Finally, we proposed a baseline model for the classification of emotions using physiological signals. The dataset is publicly available to the academic community for analysis of affective states and the development of emotion recognition models.
No takes yet. Share an insight, caveat, or question.
Pant et al. (2023) studied Healthy volunteers (n=30). Video-based emotion stimuli was evaluated. The PhyMER dataset provides physiological signals including EEG, EDA, BVP, and skin temperature, along with personality traits from 30 participants, to facilitate multimodal emotion recognition.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: