Abstract Construction workflows remain fragmented across design, robotic fabrication, and heavy machine operation, with each domain relying on separate interfaces that limit integration and operator accessibility. This paper proposes Extended Reality (XR) as a unifying interaction layer that bridges these domains by combining spatial augmentation, real-time telemetry, and an architecture designed to incorporate IFC-based construction data into a coherent operator interface. We present two prototypes involving a precise robot and heavy machinery. User studies demonstrate that XR-based interfaces improve spatial understanding and lower the entry barrier for inexperienced operators compared to conventional controls. We further identify latency, calibration stability, and haptic feedback as the key technical boundaries that currently constrain XR's effectiveness in these settings, providing a concrete design agenda for future development. Together, the prototypes demonstrate that a shared XR layer can meaningfully connect robotic fabrication and heavy machine teleoperation, offering a foundation for more integrated human–machine workflows in construction automation.
Wu et al. (Wed,) studied this question.