The effectiveness of artificial intelligence in English instruction for speaking and listening skills: A meta-analysis

The increasing integration of artificial intelligence (AI) in education has raised significant questions about its pedagogical value, especially in language learning. This meta-analysis examines the extent to which AI contributes to the development of English-speaking and listening skills. A systematic review of the literature was conducted by the preferred reporting items for systematic reviews and meta-analyses guidelines, utilizing peer-reviewed studies indexed in Scopus, ERIC, and EBSCOhost from 2017 to 2024. Nineteen studies met the inclusion criteria, all of which utilized experimental or quasi-experimental designs with measurable learning outcomes. The analysis reveals a substantial overall effect of AI-enhanced instruction (standardized mean difference SMD = 0.981, 95% confidence interval 0.571, 1.391, p .001), with particularly notable improvements in speaking proficiency (SMD = 1.033). Although listening outcomes showed a positive trend (SMD = 0.714), the effect did not attain statistical significance. Considerable heterogeneity was noted across the studies, reflecting variations in learner populations, instructional contexts, and AI applications. Quality appraisal using the risk of bias in non-randomized studies of interventions framework indicated a predominantly low to moderate risk of bias. Publication bias analysis, including funnel plot symmetry and fail-safe N, further confirmed the reliability of the results. These findings highlight the advantages of AI in enhancing speaking skills within English instruction and underscore the need for further empirical studies to investigate its impact on listening comprehension. Collectively, the results provide timely, evidence-based guidance for educators and policymakers aiming to integrate AI effectively into language education. Highlight the advantages of AI in enhancing speaking skills within English instruction and underscore the need.