What question did this study set out to answer?

This research aims to evaluate how well language model responses align with human therapist interactions during motivational interviewing sessions.

March 25, 2026Open Access

Alignment of Large Language Model Responses With Human Therapists in Motivational Interviewing

Key Points

This research aims to evaluate how well language model responses align with human therapist interactions during motivational interviewing sessions.
Analyzed 154 motivational interviewing sessions
Compared language model responses to therapist responses using similarity metrics
Identified limitations in coherence and stylistic alignment
Language model responses generally aligned with human therapist responses
Detected issues with long-range coherence and stylistic alignment
Emphasized the need for better prompt design and evaluation methods

Abstract

In this cross-sectional study of 154 MI sessions, prompted LLMs showed general alignment with therapist responses in MI-oriented conversations, as judged by automated similarity metrics. However, limitations in long-range coherence, stylistic alignment, and the use of indirect proxies for therapeutic quality highlight the need for improved prompt design, MI-specific evaluation methods, and clinical validation before integration into mental health care.

Alignment of Large Language Model Responses With Human Therapists in Motivational Interviewing

Key Points

Abstract

Cite This Study