Answers are grounded in this paper and cite their sources.
One challenge in facial action unit detection lies in the variability of facial attributes across individuals. This variability leads to diminished performance of existing AU detection methods on unseen facial identities. The primary reason for this is that the AU representations, as acquired by these methods, are closely entangled with facial identities in the training data. Consequently, the detection model tends to learn identity-specific features, which are not exclusively related to AUs. To alleviate the entanglement problem, we propose a facial geometric decoupling method inspired by 3D Morphable Model. Our approach consists of a Texture Learning (TL) module for extracting AU-related textural features, a Geometry Learning (GL) module for identity-independent geometric features via decoupling losses, and a Feature Fusion (FF) module. FF module is used to capture the interrelationship between 2D textural and 3D geometric features, then it further learns the relationship between AUs through a graph neural network. We evaluated our model on the DISFA and BP4D datasets, achieving state-of-the-art F1 scores. In addition, compared to existing methods that do not explicitly learn identity-independent features, our method maintains effectiveness on DISFA dataset with fewer facial identities, showing that our method is capable of learning more generalized AU detection features.
No takes yet. Share an insight, caveat, or question.
Shi et al. (2025) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: