General Framework, Opportunities and Challenges for Crowdsourcing Techniques: A Comprehensive Survey.
Shahzad Sarwar Bhatti,Xiaofeng Gao,Guihai Chen
DOI: https://doi.org/10.1016/j.jss.2020.110611
IF: 3.5
2020-01-01
Journal of Systems and Software
Abstract:Crowdsourcing, a distributed human problem-solving paradigm is an active research area which has attracted significant attention in the fields of computer science, business, and information systems. Crowdsourcing holds novelty with advantages like open innovation, scalability, and cost-efficiency. Although considerable research work is performed, however, a survey on the crowdsourcing process-technology has not been divulged yet. In this paper, we present a systematic survey of crowdsourcing in focussing emerging techniques and approaches for improving conventional and developing future crowdsourcing systems. We first present a simplified definition of crowdsourcing. Then, we propose a framework based on three major components, synthesize a wide spectrum of existing studies for various dimensions of the framework. According to the framework, we first introduce the initialization step, including task design, task settings, and incentive mechanisms. Next, in the implementation step, we look into task decomposition, crowd and platform selection, and task assignment. In the last step, we discuss different answer aggregation techniques, validation methods and reward tactics, and reputation management. Finally, we identify open issues and suggest possible research directions for the future. (C) 2020 Elsevier Inc. All rights reserved.