Abstract:Given a social issue that needs to be solved, decision-makers need to listen to the crowd opinions and preferences. However, existing online voting systems with limited capabilities cannot conduct such investigations. Our idea is that decision-makers can collect many human opinions from crowds on the web and then prioritize them for social decision-making. A solution of the prioritization entails collecting a large amount of pairwise preference comparisons from crowds and utilizing the aggregated preference labels as the collective preferences on the opinions. In practice, because there is a large number of combinations of all candidate opinion pairs, we can only collect a small number of labels for a small subset of pairs. How to utilize only a small number of pairwise crowd preferences on the opinions to estimate collective preferences is the problem. Existing works on preference aggregation methods for general scenarios utilize only the pairwise preference labels. In our scenario, additional contextual information, such as the text contents of the opinions, can potentially promote the aggregation performance. Therefore, we propose preference aggregation approaches that can effectively incorporate contextual information by externally or internally building the relations between the opinion contexts and preference scores. We propose approaches for both the homogeneous and heterogeneous settings of modeling the evaluators. The experiments conducted on real datasets collected from real-world crowdsourcing platform show that our approaches can generate better aggregation results than the baselines for estimating collective preferences, especially when there are only a small number of preference labels available.

Integrating Individual Preferences into Collective Argumentation

Experimental Assessment of Aggregation Principles in Argumentation-enabled Collective Intelligence

Multiperson Decision Making With Different Preference Representation Structures: A Direct Consensus Framework And Its Properties

An Approach for Combining Ethical Principles with Public Opinion to Guide Public Policy

A Collaborative Method of Aggregating Group Opinion Based on Incomplete Preferences.

Framework of Group Decision Making with Intuitionistic Fuzzy Preference Information

Consensus building in multiperson decision making with heterogeneous preference representation structures: A perspective based on prospect theory.

Integrating Incomplete Preference Estimation and Consistency Control in Consensus Reaching

Argumentation-Based Non-Monotonic Reasoning of Agents

A Group Decision Framework with Intuitionistic Preference Relations and Its Application to Low Carbon Supplier Selection

Individual, Coalitional and Structural Influence in Group Decision-Making.

Context-based Collective Preference Aggregation for Prioritizing Crowd Opinions in Social Decision-making

Group Decision Making with Heterogeneous Preference Structures: an Automatic Mechanism to Support Consensus Reaching

A Graph Model for Conflict Resolution with Inconsistent Preferences among Large-Scale Participants

Cooperative game theory based consistency and consensus reaching process for group decision making with fuzzy preference relations

Consensus Building with Individual Consistency Control in Group Decision Making

A Prospect Theory-Based Method for Fusing the Individual Preference-Approval Structures in Group Decision Making

Group Efficiency and Individual Fairness Tradeoff in Making Wise Decisions

Debate-to-Write: A Persona-Driven Multi-Agent Framework for Diverse Argument Generation

Nonlinear Programming Model Integrating Different Preference Structures

Fusion of Heterogeneous Incomplete Hesitant Preference Relations in Group Decision Making