Answers are grounded in this paper and cite their sources.
Understanding social emotion through physiological signals remains highly challenging, as it requires bulky devices and computer systems, limiting its practicality in real-world applications. Here, we propose a neuromorphic approach that decodes affective states from pupillary responses by integrating physiological feature extraction, spiking neural computation, and memristive hardware simulation. Pupil dynamics provide a noncontact physiological signal for studying social-interaction and attentional demands. We derived individual and dyadic features from infrared pupil-diameter recordings from 108 participants and encoded them as spikes for classification by a spiking neural network (SNN). The framework was evaluated in four independent binary tasks defined by the experimental protocol. These tasks examined familiarity and an empathy-related contrast, as well as competition versus cooperation and low versus high attentional demands. With solid spike encoding and a spike-event loss, the SNN trained on combined individual and interactive features achieved performance comparable to the strongest conventional machine learning baselines with an accuracy of 95.4%. We also fabricated h-BN/WSe2 memristors and used their measured conductance characteristics to calibrate a model of RRAM weight mapping and variability. Software-based inference with this model linked the measured device behavior to network performance. A variation-aware training (VAT) strategy that incorporates device-inspired noise during software training improved simulated postmapping accuracy by up to approximately 9 percentage points across the evaluated tasks. Operation-based calculations provided highly efficient estimates of arithmetic and RRAM array-core read energy, achieving approximately 11.28–11.30 fJ per synaptic operation. These results support the use of dyadic pupil features for classification of the studied conditions and demonstrate the benefit of accounting for measured device variability during software training.
No takes yet. Share an insight, caveat, or question.
Ko et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: