Synapse
⌘+K
Synapse
PulseExploreClubsResearchersJournals
Instagram
HomeClubsExplore
August 2, 2026Language TestingOpen Access

Evaluating the Validity of a Spoken Dialog System-Mediated Role-Play Test for Assessing Second Language Oral Communication

View Full Paper
Ask AI
Bookmark
Share

Authors

YKYasin KaratayCCCarol A. Chapelle

Discussion

Loading...

Member takes

Overview

Randomized trial investigates validity of AI-mediated oral tests in Turkish EFL students, suggesting SDSs enhance assessment accuracy.

Key Points

  • The study aims to evaluate the validity of a Spoken Dialog System (SDS) for assessing oral communication in second language learners.
  • Thirty Turkish English as a Foreign Language (EFL) students participated in the SDS-mediated Tourism English Speaking Test (SDS-TEST).
  • Participants completed three tasks, rated by four trained raters, using a univariate G-study and D-study for analysis.
  • Correlational analyses and qualitative insights were gathered through stimulated recalls to support validity claims.
  • The generalization inference was supported by univariate G-study analysis of 360 composite scores, suggesting reliable scoring configurations.
  • Correlational analyses revealed significant relationships with related assessments, supporting the explanation inference.
  • Qualitative insights indicated effective strategy use by participants, reinforcing the validation of the SDS-TEST.

Cite This Study

Karatay et al. (2026) studied this question.

synapsesocial.com/papers/6a6eeaf51b0468a7eeab39e2https://doi.org/10.1177/02655322261459009
View Full Paper
Ask AI
Bookmark
Share