Enhancing Seamless Body Movement Learning with Frame-by-Frame VR Presentation

Recent advancements in VR/AR display technology are expected to lead to new ways of learning physical skills through immersive and realistic experiences. However, conventional video-based VR systems often face high cognitive load, especially for complex physical movements such as dance choreography, where multiple intentions and sequential changes must be understood simultaneously. We hypothesized that replaying specific frames extracted from dance videos (frame-by-frame presentation) could reduce this cognitive load and improve the execution of dance techniques. To test this hypothesis, we developed DRF: Dance with Rhythmic Frames, a VR application that combines frame-by-frame presentation with motion trajectories. User study results indicate that with the proposed method, users can improve both choreographic dance technique and rhythm accuracy compared to video-based VR systems. By using frame-by-frame presentation, we aim to solve traditional video-based learning difficulties and support more seamless VR physical training.