Integrating dynamic temporal adjustment and multimodal language landscape translation: an innovative application for English language pedagogy

Advances in information technology have accelerated the integration of computer-assisted instruction into English language teaching. Among these technological tools, dynamic time warping (DTW) algorithms have played a central role in enhancing pedagogical effectiveness. Nevertheless, issues related to computational efficiency, recognition speed, and accuracy remain unresolved. To address these challenges, this study introduces an innovative approach that combines an enhanced DTW algorithm with multimodal language landscapes, integrating speech, visual cues, and textual data to improve pronunciation and oral expression training for English learners. The optimized system exhibited notable performance: under 10 dB signal-to-noise ratio (SNR) conditions, it achieved recognition accuracies of 82.43% for multi-channel interference and 85.92% for white noise. These rates increased to 97.14% and 98.12%, respectively, at 20 dB SNR, and reached a peak of 99.03% in clean speech environments. The improved DTW algorithm attained a 90.64% gain in computational efficiency over conventional methods while sustaining a speech recognition success rate above 90%, with error margins limited to ±0.2, indicating high stability and precision. By incorporating multimodal linguistic contexts—such as visual articulatory gestures and contextual text—the system helps learners connect phonetic patterns with real-world communication scenarios, thereby closing the gap between theoretical language research and practical teaching requirements. These developments not only improve real-time adaptive feedback for pronunciation correction but also facilitate the diagnosis and resolution of learner-specific issues by educators. This study has laid the groundwork for a scalable framework to modernize language instruction, highlighting the potential of computationally robust and context-aware tools to transform foreign language education by aligning technological advances with learner-centered pedagogical processes.