Abstract:There are two problems in the traditional crowdsourcing systems for handling complex tasks. First, decomposing complex tasks into a set of micro-subtasks requires the decomposition capability of the requesters; thus, some requesters may abandon using crowdsourcing to accomplish a large number of complex tasks since they cannot bear such heavy burden by themselves. Second, tasks are often assigned redundantly to multiple workers to achieve reliable results, but reliability may not be ensured when there are many malicious workers in the crowd. Currently, it is observed that the workers are often connected through social networks, a feature that can significantly facilitate task allocation and task execution in crowdsourcing. Therefore, this paper investigates crowdsourcing in social networks and presents a novel context-aware reliable crowdsourcing approach. In our presented approach, the two problems in traditional crowdsourcing are addressed as follows: 1) the complex tasks can be performed through autonomous coordination between the assigned worker and his contextual workers in the social network; thus, the requesters can be exempt from a heavy computing load for decomposing complex tasks into subtasks and combing the partial results of subtasks, thereby enabling more requesters to accomplish a large number of complex tasks through crowdsourcing, and 2) the reliability of a worker is determined not only by the reputation of the worker himself but also by the reputations of the contextual workers in the social network; thus, the unreliability of transient or malicious workers can be effectively addressed. The presented approach addresses two types of social networks including simplex and multiplex networks. Based on theoretical analyses and experiments on a real-world dataset, we find that the presented approach can achieve significantly higher task allocation and execution efficiency than the previous benchmark task allocation approaches; moreover, the presented contextual reputation mechanism can achieve relatively higher reliability when there are many malicious workers in the crowd.

Effective Result Inference for Context-Sensitive Tasks in Crowdsourcing.

Context-aware Result Inference in Crowdsourcing.

P&T-Inf: A Result Inference Method for Context-Sensitive Tasks in Crowdsourcing

SLADE: A Smart Large-Scale Task Decomposer in Crowdsourcing

Adaptive Result Inference for Collecting Quantitative Data with Crowdsourcing.

Collusion-Proof Result Inference in Crowdsourcing

Answer Inference for Crowdsourcing Based Scoring

Incremental Quality Inference In Crowdsourcing

Multi-Factor Influencing Truth Inference in Crowdsourcing.

Achieving Approximate Global Optimization of Truth Inference for Crowdsourcing Microtasks

Context-Aware Reliable Crowdsourcing in Social Networks

Mixture of Experts based Multi-task Supervise Learning from Crowds

A Decision Tree Based Quality Control Framework for Multi-phase Tasks in Crowdsourcing.

Personalized and Quality-Aware Task Recommendation in Collaborative Crowdsourcing

A Novel Crowd-sourcing Inference Method

Modeling Random Guessing and Task Difficulty for Truth Inference in Crowdsourcing

Icrowd: An Adaptive Crowdsourcing Framework

A Model for Aggregating Contributions of Synergistic Crowdsourcing Workflows

Cross-domain-aware Worker Selection with Training for Crowdsourced Annotation

Crowdsourced POI Labelling: Location-aware Result Inference and Task Assignment.

Dynamic Task Allocation for Crowdsourcing Settings