A Survey on Task Assignment in Crowdsourcing

Danula Hettiachchi,Vassilis Kostakos,Jorge Goncalves
DOI: https://doi.org/10.1145/3494522
IF: 16.6
2023-04-30
ACM Computing Surveys
Abstract:Quality improvement methods are essential to gathering high-quality crowdsourced data, both for research and industry applications. A popular and broadly applicable method is task assignment that dynamically adjusts crowd workflow parameters. In this survey, we review task assignment methods that address: heterogeneous task assignment, question assignment, and plurality problems in crowdsourcing. We discuss and contrast how these methods estimate worker performance, and highlight potential challenges in their implementation. Finally, we discuss future research directions for task assignment methods, and how crowdsourcing platforms and other stakeholders can benefit from them.
computer science, theory & methods
What problem does this paper attempt to address?