Answers are grounded in this paper and cite their sources.
Head pose estimation plays an important role in many real-world applications. However, the performance of existing methods degrades significantly when facial regions are occluded by face masks. To address this limitation, this paper proposes a two-stage framework that integrates diffusion-based face restoration with landmark-independent head pose estimation. In the proposed framework, face mask regions are first detected through segmentation, and the occluded facial regions are reconstructed using a pretrained Stable Diffusion model. The restored facial images are then fed into a deep learning-based head pose estimation model to predict the yaw, pitch, and roll angles. Experiments were conducted on a masked-face dataset constructed from AFLW2000 dataset by synthesizing realistic face-mask occlusions. The proposed framework achieves an average Mean Absolute Error (MAE) of 3.83° under mask occlusion, outperforming the landmark-based baseline and the evaluated landmark-independent head pose estimation methods. Furthermore, an ablation study shows that diffusion-based face restoration reduces the Average MAE from 5.43° to 3.83°, demonstrating its effectiveness in mitigating the information loss caused by facial occlusion and improving head pose estimation accuracy.
No takes yet. Share an insight, caveat, or question.
Hiratani et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: