Accurate 3D human pose reconstruction from a single RGB image remains challenging due to scale ambiguity and perspective distortions. Current single-view methods primarily rely on learned priors or kinematic constraints, but they often struggle to maintain geometric consistency with the physical scene. This results in horizon alignment drift and instability when rendered in metric environments. To overcome these limitations, this study introduces a vanishing-point-driven framework that integrates scene geometry into the pose correction process. Under the Manhattan-world assumption, dominant vanishing points are detected to estimate the ground plane and recover the camera orientation with high precision. A lightweight 3D pose estimation network generates initial joint coordinates in camera-centric space. These coordinates are then refined through a VP-based ground-alignment transformation, which resolves scale ambiguity and minimizes geometric drift. The corrected poses are normalized to physical scale and streamed to NVIDIA OmniverseTM for real-time digital-twin visualization. Experiments conducted on indoor scenes from the NYU Depth V2 dataset demonstrate sub-pixel accuracy in vanishing-point localization and significant improvements in geometric alignment between the reconstructed poses and the true scene layout. This confirms the effectiveness of the proposed approach for single-view digital-twin human modeling.
Cho et al. (Mon,) studied this question.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: