Artificial Intelligence integration with mobile instant messaging (MIM) offers promising support for blended learning discussions, yet current implementations often favor immediacy over pedagogical structure. Despite separate studies on Socratic methods, ChatGPT applications, and MIM platforms, their systematic integration remains unexplored. This study introduces SCMIM (Socratic-based ChatGPT Mobile Instant Messaging) and compares its impact with standard ChatGPT-MIM and traditional MIM through a 12-week randomized trial with 72 master’s students. Using mixed-methods analysis of engagement questionnaires, discussion logs, and interviews, we examined behavioral, cognitive, and emotional engagement alongside technology acceptance perceptions. Results showed ChatGPT-MIM enhanced behavioral participation and emotional comfort through immediate support, while SCMIM more effectively fostered cognitive engagement, particularly analytical thinking and knowledge construction. Despite initial adaptation challenges, SCMIM users developed appreciation for systematic questioning, reporting high perceived usefulness and comparable intention to use. These findings demonstrate that effective AI integration requires balancing immediate support with structured pedagogical guidance to promote both engagement and deeper learning outcomes in educational discussions.
Lee et al. (Sat,) studied this question.