Real-Time Hand Tracking and Collision Detection for Immersive Mixed-Reality Boxing Training on Apple Vision Pro

This study presents a real-time hand tracking and collision detection system for immersive mixed-reality boxing training on Apple Vision Pro (Apple Inc., Cupertino, CA, USA). Leveraging the device’s advanced spatial computing capabilities, this research addresses the limitations of traditional fitness applications that lack precision for technique-based sports like boxing with visual-only hand tracking. The system is designed to provide objective feedback by recognizing boxing-specific gestures with sub-centimeter accuracy and validating biomechanical correctness during punch execution. A three-stage pipeline consisting of geometric filtering, biomechanical validation, and punch technique assessment rejects accidental or improper motions. Experimental evaluation involving 12 participants demonstrated a gesture recognition accuracy of 96.3% and a technique validation accuracy of 88.5%. The system consistently operated at 60 FPS with low latency and high robustness across diverse lighting conditions. These results indicate the potential of Apple Vision Pro as a platform for precision sports training and highlight the educational impact of mixed reality in democratizing access to high-quality boxing instruction. The proposed framework is extensible to other skill-based sports requiring fine motor control and real-time feedback.