Phy-HHMR: Physics-Aware Holistic Human Mesh Reconstruction

In recent years, single-image-based 3-D human modeling has become a promising research direction, with potential applications in augmented reality, human–computer interaction. However, 3-D human body modeling from a single image often produces physically unreasonable results in close-interaction scenarios due to severe occlusion and depth ambiguity. We propose a physics-aware framework for holistic human mesh recovery (Phy-HHMR), a physics-driven holistic reconstruction system that recovers expressive 3-D meshes within a unified framework. Our method features an interaction-aware optimization pipeline, combining physical consistency priors with spatially guided diffusion refinement. By employing geometric gap regularization and tokenized motion memory, the system ensures nonpenetration and contact plausibility, maintaining kinematic accuracy and a physical foundation. Phy-HHMR leverages a system-level joint optimization strategy and paired-flow couplers to sustain overall mechanical consistency. Simulation results show that our method achieves state-of-the-art performance and stronger robustness to reconstruction defects, providing a reliable basis for virtual reality and human–computer collaboration.