What type of study is this?

September 5, 2025Open Access

Evaluating an LLM’s Performance in Annotating Discourse Strategies

View Full Paper

Ask AI

Bookmark

Authors

TMTaylor MeizlishNagoya University of Foreign Studies CZChris ZiffoNagoya University of Foreign Studies

Discussion

Member takes

Implication

This analysis shows an LLM enhances accuracy in annotating discourse strategies in writings of Japanese students, implying greater efficiency for corpus linguistics.

Key Points

An LLM effectively improves pragmatic annotation, enhancing the quality of discourse strategy identification.
ChatGPT-4 demonstrated high reliability and human-rater agreement when evaluating refusal strategies among students.
The study analyzed English writing samples from Japanese university students, showing the LLM’s potential for scalable annotation.
Findings indicate that LLMs can significantly aid in pragmatic annotation, which may transform approaches in corpus linguistics.

Cite This Study

Meizlish et al. (2025) studied this question.

synapsesocial.com/papers/68bb5f076d6d5674bcd02c2d https://doi.org/10.21203/rs.3.rs-7246876/v1

View Full Paper

Ask AI

Bookmark

Implication

This analysis shows an LLM enhances accuracy in annotating discourse strategies in writings of Japanese students, implying greater efficiency for corpus linguistics.

Evaluating an LLM’s Performance in Annotating Discourse Strategies

Discussion

Member takes

Implication

Key Points

Cite This Study

Evaluating an LLM’s Performance in Annotating Discourse Strategies

Discussion

Member takes

Implication

Key Points

Cite This Study

Also Consider

Also Consider