Exploring English for academic purposes instructors’ perceptions of speech fluency through developing and piloting a rating scale for a paired conversational task

Much research has explored how perceptions of speech fluency are influenced by a variety of temporal speech features (e.g. speech rate). However, less is known about the influence of non-temporal and conversational speech characteristics on fluency perceptions. To address this gap, this study explored English for Academic Purposes (EAP) instructors' perceptions of speech fluency through developing and piloting a rating scale for a paired conversational task for assessment for learning purposes. A two-phase mixed-methods sequential exploratory design (Creswell, 2009) was used. Seven trained EAP instructors watched videos of seven-minute conversations, elicited from 14 intermediate-to-advanced EAP learners. Afterwards, instructors were audio-recorded discussing their observations about learners' fluency. These recordings were transcribed and coded using in-vivo and pattern coding techniques (Saldaña, 2009). Six themes were identified: efficiency, smoothness, sophistication, clarity, facilitating topics and turns, and supporting the conversation partner. These themes informed the development of a multi-item fluency rating scale. 35 EAP instructors then used the scale to rate eight learners' speeches. To investigate the construct-relevance of these scale items, a principal component analysis was conducted, producing two components - individual fluency and conversational fluency. Pedagogical activities aligned with the scale are provided.