Answers are grounded in this paper and cite their sources.
Aggregating the choices regarding a given decision problem made by multiple individuals into a single solution is essential for exploiting the collective’s intelligence and effective crowdsourcing. There are various aggregation techniques, some of which come down to a simple aggregation rule, such as the majority rule. We propose two one-shot machine-learning-based aggregation approaches, which also exploit the existence of meta-cognitive features such as confidence. The first predicts which aggregation method will be best for a given collective decision-making case. The second directly predicts which decision is optimal given the selection made by each method. We offer a meta-cognitive feature-engineering approach for characterizing a collective decision-making case in a context-sensitive fashion. Experimental results show that using either of our proposed approaches increases the percentage of successfully aggregated cases, compared to the uniform application of the best rule-based aggregation method, by 5.8% and 6%. Furthermore, when an aggregation method is selected by our classifier, its effectiveness increases by an absolute percentage of 6.5% to 32.6%. We also offer a new aggregation method, the Devil’s-Advocate aggregator, to deal with cases in which standard aggregation methods fail. Ablation experiments demonstrate that removing the Devil’s Advocate aggregator decreases the success rate by 5.2%.
No takes yet. Share an insight, caveat, or question.
Shinitzky et al. (2025) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: