Answers are grounded in this paper and cite their sources.
Large language model (LLM)-based multi-agent systems are increasingly being explored as tools for supporting structured collective decision-making, but it remains unclear how the diversity structure of agent groups affects decision-making performance. This study examined the effects of agent diversity in a Delphi-based multi-agent system by applying Harrison and Klein’s framework of variety, separation, and disparity. An LLM-based Multi-Agent Delphi System (MADS) was implemented, and 11 agent-group conditions were constructed by manipulating personality-based variety, belief-orientation-based separation, and influence asymmetry. Each condition consisted of eight agents and was tested across four open-weight LLMs with repeated experimental runs. Performance was evaluated in terms of idea exploration extent, consensus quality, and consensus efficiency, using a human expert Delphi study as an external benchmark. The results showed that diversity had differentiated effects across performance dimensions. The maximum diversity group achieved the highest idea exploration but showed low consensus quality and efficiency, whereas the homogeneous group achieved stable consensus quality and efficiency but limited exploration. The separation diversity conditions formed Pareto-efficient alternatives, indicating balanced trade-offs between idea exploration and consensus. These findings indicate that agent diversity does not uniformly improve collective decision-making performance; instead, its appropriate structure depends on whether the task prioritizes exploration, consensus quality, or consensus efficiency.
No takes yet. Share an insight, caveat, or question.
Lee et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: