PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
March 3, 2026SHILAP Revista de lepidopterología3 citationsOpen Access

AI-Enhanced Skill Assessment in Higher Vocational Education: A Systematic Review and Meta-Analysis

XSXia SunHTHaoheng Tian

Key Points

  • Moderate positive association of AI-supported assessment systems with skill-related learning outcomes was evident.
  • The meta-analysis involved 27 studies published from 2010 to 2024, revealing a Hedges’ g of 0.72.
  • Systematic review and meta-analysis conducted following PRISMA 2020 guidelines ensures methodological rigor.
  • Current findings suggest the need for more robust, theory-informed research as applications of generative AI evolve.

Abstract

This study synthesizes empirical evidence on AI-supported skill assessment systems in higher vocational education through a systematic review and meta-analysis. Despite growing interest in generative AI within higher education, empirical research on AI-enabled assessment remains fragmented and methodologically uneven, particularly in vocational contexts. Following PRISMA 2020 guidelines, 27 peer-reviewed empirical studies published between 2010 and 2024 were identified from major international and Chinese databases and included in the analysis. Using a random-effects model, the meta-analysis indicates a moderate positive association between AI-supported assessment systems and skill-related learning outcomes (Hedges’ g = 0.72), alongside substantial heterogeneity across study designs, outcome measures, and implementation contexts. Subgroup analyses suggest variation across regional and institutional settings, which should be interpreted cautiously given small sample sizes and diverse methodological approaches. Based on the synthesized evidence, the study proposes a conceptual AI-supported skill assessment framework that distinguishes empirically grounded components from forward-looking extensions related to generative AI. Rather than offering prescriptive solutions, the framework provides an evidence-informed baseline to support future research, system design, and responsible integration of generative AI in higher education assessment. Overall, the findings highlight both the potential and the current empirical limitations of AI-enabled assessment, underscoring the need for more robust, theory-informed, and transparent studies as generative AI applications continue to evolve.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Sun et al. (2026) studied this question.

synapsesocial.com/papers/69a75d02c6e9836116a26670https://doi.org/10.3390/informatics13020020
Ask AI
Helpful
Bookmark
Share
View Full Paper