PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
October 16, 20250 citationsOpen Access

SOTOPIA-: Dynamic Strategy Injection Learning and Social Instruction Following Evaluation for Social Agents

View Full Paper
WZW. ZhangTLTianyun LiuMSMengxiao Song

Key Points

  • The framework significantly enhances social goals beyond expert models like GPT-4 and improves social instruction following.
  • Dynamic strategy injection from negotiation theory automates high-quality corpus creation for social dialogue training.
  • Evaluation metrics for social instruction following complement the social capability enhancement strategies presented.
  • The proposed method mitigates prolonged deadlock in agent interactions, suggesting robust improvements in social dialogue.

Abstract

Despite the abundance of prior social strategies possessed by humans, there remains a paucity of research dedicated to their transfer and integration into social agents. Our proposed SOTOPIA- framework aims to address and bridge this gap, with a particular focus on enhancing the social capabilities of language agents. This framework dynamically injects multi-step reasoning strategies inspired by negotiation theory and two simple direct strategies into expert agents, thereby automating the construction of a high-quality social dialogue training corpus. Additionally, we introduce the concept of Social Instruction Following (S-IF) and propose two new S-IF evaluation metrics that complement social capability. We demonstrate that several 7B models trained on high-quality corpus not only significantly surpass the expert agent (GPT-4) in achieving social goals but also enhance S-IF performance. Analysis and variant experiments validate the advantages of dynamic construction, which can especially break the agent's prolonged deadlock.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Zhang et al. (2025) studied this question.

synapsesocial.com/papers/68f0d5eb105731330a2b1e80https://doi.org/10.48550/arxiv.2502.15538
Ask AI
Helpful
Bookmark
Share
View Full Paper