This is the authors' abstract. We don't add key points for this paper.
Accurate 3D mouth localization from a single camera remains challenging in smart spaces, where speakers appear at low resolution and under unconstrained head poses. Most existing audiovisual tracking methods approximate the mouth position using a fixed location within the detected face bounding box, implicitly assuming frontal pose and leading to large errors under head rotations. In addition, monocular 3D estimation suffers from scale ambiguity, i.e., the inherent uncertainty between object size and distance in 2D image projections. We investigate whether head pose estimation (HPE) can overcome these limitations. Two monocular approaches are proposed: LPoseVL , combining facial landmarks with geometric pose recovery using a rigid 3D head model, and LFreeVL , based on landmark-free 6DoF pose estimation with calibration. Experiments on the AV16.3 and CAV3D datasets show that explicitly modeling head pose significantly improves accuracy, achieving up to 46.9% error reduction over bounding-box-based state-of-the-art methods.
Answers are grounded in this paper and cite their sources.
No takes yet. Share an insight, caveat, or question.
Sanabria-Macias et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: