Abstract:Crowdsourcing has been shown to be effective in a wide range of applications, and is seeing increasing use. A large-scale crowdsourcing task often consists of thousands or millions of atomic tasks, each of which is usually a simple task such as binary choice or simple voting. To distribute a large-scale crowdsourcing task to limited crowd workers, a common practice is to pack a set of atomic tasks into a task bin and send to a crowd worker in a batch. It is challenging to decompose a large-scale crowdsourcing task and execute batches of atomic tasks, which ensures reliable answers at a minimal total cost. Large batches lead to unreliable answers of atomic tasks, while small batches incur unnecessary cost. In this paper, we investigate a general crowdsourcing task decomposition problem, called the Smart Large-scAle task DE composer (SLADE) problem, which aims to decompose a large-scale crowdsourcing task to achieve the desired reliability at a minimal cost. We prove the NP-hardness of the SLADE problem and propose solutions in both homogeneous and heterogeneous scenarios. For the homogeneous SLADE problem, where all the atomic tasks share the same reliability requirement, we propose a greedy heuristic algorithm and an efficient and effective approximation framework using an optimal priority queue (OPQ) structure with provable approximation ratio. For the heterogeneous SLADE problem, where the atomic tasks can have different reliability requirements, we extend the OPQ-based framework leveraging a partition strategy, and also prove its approximation guarantee. Finally, we verify the effectiveness and efficiency of the proposed solutions through extensive experiments on representative crowdsourcing platforms.

Task Assignments in Complex Collaborative Crowdsourcing

Task Assignment with Guaranteed Quality for Crowdsourcing Platforms.

Matchmaker: Stable Task Assignment with Bounded Constraints for Crowdsourcing Platforms

Stable Job Assignment for Crowdsourcing.

Multi-stage complex task assignment in spatial crowdsourcing

SLADE: A Smart Large-Scale Task Decomposer in Crowdsourcing

Multi-Robot Coordination In Complex Environment With Task And Communication Constraints

Efficient Cross Dynamic Task Assignment in Spatial Crowdsourcing.

Research on the Optimal Combination and Scheduling Method of Crowdsourcing Members in a Cloud Design Platform

Greedy Task Assignment Algorithm for Collaborative Crowdsensing

Task Assignment on Multi-Skill Oriented Spatial Crowdsourcing

Learning Complex Crowdsourcing Task Allocation Strategies from Humans

Trajectory-Aware Task Coalition Assignment in Spatial Crowdsourcing

Multi-skill aware task assignment in real-time spatial crowdsourcing

A novel coverage-aware task allocation scheme in Cooperative Mobile Crowd Sensing

Quality-Assured Synchronized Task Assignment in Crowdsourcing

Crowdota: An Online Task Assignment System In Crowdsourcing

Combined Crowdsourcing Task Auction Mechanism Based on Stable Matching.

Group task allocation approach for heterogeneous software crowdsourcing tasks

Task Allocation in Spatial Crowdsourcing: Current State and Future Directions

Profit-driven Task Assignment in Spatial Crowdsourcing