Are Social Dominance-Based Faultlines Harmful in Crowdsourcing Tournaments?

Fang Cao,Weiquan Wang,Chee-wee Tan,Eric.T.K. Lim,Xinmei Liu

DOI: https://doi.org/10.5465/ambpp.2018.184

2018-01-01

Abstract:Firms organize tournaments in crowdsourcing platforms to outsource complex tasks to external contributors. Members of a crowdsourcing platform may form temporarily self-organized virtual teams to p...

What problem does this paper attempt to address?

Do Social Dominance-Based Faultlines Help or Hurt Team Performance in Crowdsourcing Tournaments?

Fang Cao,Weiquan Wang,Eric Lim,Xinmei Liu,Chee-Wee Tan

DOI: https://doi.org/10.1080/07421222.2021.2023403

IF: 7.582

2022-01-01

Journal of Management Information Systems

Abstract:Firms organize tournaments on online crowdsourcing platforms to outsource complex business problems to external solvers. Participants on these platforms often self-organize into ad-hoc virtual teams to compete in such tournaments. Social dominance-based faultlines, which originate from the alignment of members based on IT-enabled social dominance attributes (e.g., rank and tier), have emerged as a novel type of faultline in crowdsourcing teams. Building on the Categorization-Elaboration Model (CEM), we investigate the contingent effects of team ability and team effort on the relationship between social dominance-based faultlines and team performance in crowdsourcing tournaments. We collected data of 265 virtual teams from Kaggle.com. We discovered that IT-enabled social dominance-based faultlines positively influence the performance of teams with low ability and high effort, whereas the effect becomes negative for teams with high ability and low effort. Our study yields theoretical implications by advancing a novel type of social dominance-based faultline and extending the CEM with two contingent factors (i.e., team effort and team ability) pertinent to team performance on crowdsourcing tournaments. We also offer practical guidelines for team formation in crowdsourcing tournaments and for the design of crowdsourcing platforms.
Matchmaker: Stable Task Assignment with Bounded Constraints for Crowdsourcing Platforms

Xiaoyan Yin,Yanjiao Chen,Cheng Xu,Sijia Yu,Baochun Li

DOI: https://doi.org/10.1109/jiot.2020.3014440

IF: 10.6

2021-01-01

IEEE Internet of Things Journal

Abstract:Crowdsourcing has become a popular paradigm to leverage the collective intelligence of massive crowd workers to perform certain tasks in a cost-effective way. Task assignment is an essential issue in crowdsourcing platforms owing to heterogeneous tasks and work skills. In this article, we focus on assigning workers with diversified skill levels to crowdsourcing tasks with different quality requirements and budget constraints. Task assignment is fundamentally a many-to-one matching problem, where one task is allocated to multiple users who can meet the minimum quality requirement of the task within the limited budget. While most existing works try to maximize the utility of the crowdsourcing platform, we take into account the individual preferences of crowdsourcers and workers toward each other to ensure the stability of task assignment results. In this article, we propose task assignment mechanisms that can guarantee stable outcomes for the many-to-one matching problem with lower and upper bounds (i.e., quality requirement and budget constraint) in regard to heterogeneous worker skill levels. Extensive simulation results show that the proposed algorithms can greatly improve the success ratio of task accomplishment and worker happiness compared with existing algorithms.
Task Assignment with Guaranteed Quality for Crowdsourcing Platforms.

Xiaoyan Yin,Yanjiao Chen,Baochun Li

DOI: https://doi.org/10.1109/iwqos.2017.7969165

2017-01-01

Abstract:Crowdsourcing leverages the collective intelligence of the massive crowd workers to accomplish tasks in a cost-effective way. On a crowdsourcing platform, it is challenging to assign tasks to workers in an appropriate way due to heterogeneity in both tasks and workers. In this paper, we explore the problem of assigning workers with various skill levels to tasks with different quality requirements and budget constraints. We first formulate the task assignment as a many-to-one matching problem, in which multiple workers are assigned to a task, and the task can be successfully completed only if a minimum quality requirement can be satisfied within its limited budget. Different from traditional task assignment mechanisms which focus on utility maximization for the crowdsourcing platform, our proposed matching framework takes into consideration the preferences of individual crowdsourcers and workers towards each other. We design a novel algorithm that can generate a stable outcome for the many-to-one matching problem with lower and upper bounds (i.e., quality requirement and budget constraint), as well as heterogeneous worker skill levels. Through extensive simulations, we show that the proposed algorithm can greatly improve the success ratio of task accomplishment and worker happiness, when compared with existing algorithms.
An Incentive Mechanism for Crowdsourcing Systems with Network Effects

Yanjiao Chen,Xu Wang,Baochun Li,Qian Zhang

DOI: https://doi.org/10.1145/3347514

IF: 5.3

2019-01-01

ACM Transactions on Internet Technology

Abstract:In a crowdsourcing system, it is important for the crowdsourcer to engineer extrinsic rewards to incentivize the participants. With mobile social networking, a user enjoys an intrinsic benefit when she aligns her behavior with the behavior of others. Referred to as network effects, such an intrinsic benefit becomes more significant as more users join and contribute to the crowdsourcing system. But should a crowdsourcer design her extrinsic rewards differently when such network effects are taken into consideration? In this article, we incorporate network effects as a contributing factor to intrinsic rewards, and study its influence on the design of extrinsic rewards. We show that the number of participating users and their contributions to the crowdsourcing system evolve to a steady equilibrium, thanks to subtle interactions between intrinsic rewards due to network effects and extrinsic rewards offered by the crowdsourcer. Taken network effects into consideration, we design progressively more sophisticated extrinsic reward mechanisms, and propose new and optimal strategies for a crowdsourcer to obtain a higher utility. Through simulations and examples, we demonstrate that with our new strategies, a crowdsourcer is able to attract more participants with higher contributed efforts; and the participants gain higher utilities from both intrinsic and extrinsic rewards.
Social Sourcing: Incorporating Social Networks Into Crowdsourcing Contest Design

Qi Shi,Dong Hao

DOI: https://doi.org/10.1109/TNET.2022.3223367

2022-11-22

Abstract:In a crowdsourcing contest, a principal holding a task posts it to a crowd. People in the crowd then compete with each other to win the rewards. Although in real life, a crowd is usually networked and people influence each other via social ties, existing crowdsourcing contest theories do not aim to answer how interpersonal relationships influence people's incentives and behaviors and thereby affect the crowdsourcing performance. In this work, we novelly take people's social ties as a key factor in the modeling and designing of agents' incentives in crowdsourcing contests. We establish two contest mechanisms by which the principal can impel the agents to invite their neighbors to contribute to the task. The first mechanism has a symmetric Bayesian Nash equilibrium, and it is very simple for agents to play and easy for the principal to predict the contest performance. The second mechanism has an asymmetric Bayesian Nash equilibrium, and agents' behaviors in equilibrium show a vast diversity which is strongly related to their social relations. The Bayesian Nash equilibrium analysis of these new mechanisms reveals that, besides agents' intrinsic abilities, the social relations among them also play a central role in decision-making. Moreover, we design an effective algorithm to automatically compute the Bayesian Nash equilibrium of the invitation crowdsourcing contest and further adapt it to a large graph dataset. Both theoretical and empirical results show that the new invitation crowdsourcing contests can substantially enlarge the number of participants, whereby the principal can obtain significantly better solutions without a large advertisement expenditure.

Artificial Intelligence,Computer Science and Game Theory,Theoretical Economics
Task Division for Team Success in Crowdsourcing Contests: Resource Allocation and Alignment Effects

Indika Dissanayake,Jie Zhang,Bin Gu

DOI: https://doi.org/10.1080/07421222.2015.1068604

IF: 7.582

2015-04-03

Journal of Management Information Systems

Abstract:Advances in information technology bring changes to the nature of work by facilitating companies to go beyond the wisdom of their workforce and tap into the “wisdom of the crowd” via online crowdsourcing contests. In these contests, active and motivated individuals collaborate in the form of self-organized teams that compete for rewards. Using a rich data set of 732 teams in 52 contests collected from the crowdsourcing platform, Kaggle.com, from its launch in April 2010 to July 2012, we studied how the allocation of members’ social and intellectual capital within a virtual team affects team performance in online crowdsourcing contests. Our econometric analysis uses a rank-ordered logistic regression model, and suggests that the effect of a member’s social and intellectual capital on team performance varies depending on his or her roles. Though a team leader’s social capital and a team expert’s intellectual capital significantly influence team performance, a team leader’s intellectual capital and a team expert’s social capital do not. Further, we found that the alignment of a member’s social and intellectual capital within a team has a significant influence on team performance. Moreover, the intensity of the competition moderates the impact. When a contest is highly competitive, the social and intellectual capital alignment negatively affects team performance, and when the competitive intensity is low, this alignment positively affects team performance. Our findings provide insights into improving performance in team-based competitions in crowdsourcing communities.

information science & library science,management,computer science, information systems
Crowdsourcing Contests: Understanding the Effect of Environment and Organization Specific Factors on Sustained Participation

Hanieh Javadi Khasraghi,Xuan Wang,Yaojie Li,Yi Liu

DOI: https://doi.org/10.1080/10580530.2024.2382107

2024-01-01

Information Systems Management

Abstract:Crowdsourcing contests are vital for organizational problem-solving and decision-making. Continued participation in these contests ensures platform success, yet environment- and organization-specific factors are underexplored. This study addresses this gap by examining how team ties, organization exposure, and experience with the organization impact sustained participation in crowdsourcing contests. An empirical study of 9,596 individuals across 138 Kaggle.com contests reveals these factors significantly influence ongoing participation. To foster collaboration and long-term engagement, platforms should highlight information about sponsoring organizations. These findings enhance understanding of leveraging environment- and organization-specific factors for sustained crowdsourcing success.
Competing Openly or Blindly in Crowdsourcing Contests ?

Lian Jian,Zheng Li,Tracy Xiao Liu

2014-01-01

Abstract:Organizations are increasingly outsourcing tasks once performed in-house to wider participants on the Internet by hosting online contests. In practice, two types of mechanisms are used to organize these contests: simultaneous (blind) and sequential (open). In a simultaneous contest, contestants submit their solutions independently without access to one another’s submissions, while in a sequential contest, contestants submit their solutions sequentially and each can view all prior submissions before making their decisions. Most prior theoretical and experimental research has focused on simultaneous contests, with only a handful that have studied sequential ones. In this paper, under the condition of incomplete information, we analytically show that simultaneous contests produce higher quality best solutions than sequential contests. Using a laboratory experiment, we test this theoretical prediction as well as the prediction that simultaneous contests are more efficient than sequential contests. Our data support both predictions. We also discover that as the number of contestants increases, the efficiency of sequential contests drops significantly, further reducing their performance relative to simultaneous contests.
Crowdsourcing Team Formation With Worker-Centered Modeling

Federica Lucia Vinella,Jiayuan Hu,Ioanna Lykourentzou,Judith Masthoff

DOI: https://doi.org/10.3389/frai.2022.818562

2022-05-27

Frontiers in Artificial Intelligence

Abstract:Modern crowdsourcing offers the potential to produce solutions for increasingly complex tasks requiring teamwork and collective labor. However, the vast scale of the crowd makes forming project teams an intractable problem to coordinate manually. To date, most crowdsourcing collaborative platforms rely on algorithms to automate team formation based on worker profiling data and task objectives. As a top-down strategy, algorithmic crowd team formation tends to alienate workers causing poor collaboration, interpersonal clashes, and dissatisfaction. In this paper, we investigate different ways that crowd teams can be formed through three team formation models namely bottom-up, top-down, and hybrid. By simulating an open collaboration scenario such as a hackathon, we observe that the bottom-up model forms the most competitive teams with the highest teamwork quality. Furthermore, we note that bottom-up approaches are particularly suitable for populations with high-risk appetites (most workers being lenient toward exploring new team configurations) and high degrees of homophily (most workers preferring to work with similar teammates). Our study highlights the importance of integrating worker agency in algorithm-mediated team formation systems, especially in collaborative/competitive settings, and bears practical implications for large-scale crowdsourcing platforms.
Quality-Aware Incentive Mechanisms Under Social Influences in Data Crowdsourcing

Zhiguo Shi,Guang Yang,Xiaowen Gong,Shibo He,Jiming Chen

DOI: https://doi.org/10.1109/TNET.2021.3105427

2022-01-01

IEEE/ACM Transactions on Networking

Abstract:Incentive mechanism design and quality control are two key challenges in data crowdsourcing, because of the need for recruitment of crowd users and their limited capabilities. Without considering users' social influences, existing mechanisms often result in low efficiency in terms of the platform's cost. In this paper, we exploit social influences among users as incentives to motivate users' participation, in order to reduce the cost of recruiting users. Based on social influences, we design incentive mechanisms with the goal of achieving high quality of crowdsourced data and low cost of incentivizing users' participation. Specifically, we consider three scenarios. In the full information scenario, we design task assignment and user recruitment mechanisms to optimize the data quality while reducing the incentive cost. In the partial information scenario, users' qualities and costs are unknown. We exploit the correlation between tasks to overcome the information asymmetry, for both cases of opportunistic crowdsourcing and participatory crowdsourcing. Further, in the dynamic social influence scenario, we investigate the dynamics of users' social influences and design extra rewards for users to make full use of the social influence and achieve maximum cost saving. We evaluate the incentive mechanisms using numerical results, which demonstrate their effectiveness.
Competition and Collaboration in Crowdsourcing Communities: What happens when peers evaluate each other?

Christoph Riedl,Tom Grad,Christopher Lettl

DOI: https://doi.org/10.1287/orsc.2021.15163

2024-04-22

Abstract:Crowdsourcing has evolved as an organizational approach to distributed problem solving and innovation. As contests are embedded in online communities and evaluation rights are assigned to the crowd, community members face a tension: they find themselves exposed to both competitive motives to win the contest prize and collaborative participation motives in the community. The competitive motive suggests they may evaluate rivals strategically according to their self-interest, the collaborative motive suggests they may evaluate their peers truthfully according to mutual interest. Using field data from Threadless on 38 million peer evaluations of more than 150,000 submissions across 75,000 individuals over 10 years and two natural experiments to rule out alternative explanations, we answer the question of how community members resolve this tension. We show that as their skill level increases, they become increasingly competitive and shift from using self-promotion to sabotaging their closest competitors. However, we also find signs of collaborative behavior when high-skilled members show leniency toward those community members who do not directly threaten their chance of winning. We explain how the individual-level use of strategic evaluations translates into important organizational-level outcomes by affecting the community structure through individuals' long-term participation. While low-skill targets of sabotage are less likely to participate in future contests, high-skill targets are more likely. This suggests a feedback loop between competitive evaluation behavior and future participation. These findings have important implications for the literature on crowdsourcing design, and the evolution and sustainability of crowdsourcing communities.

General Economics,Computer Science and Game Theory,Human-Computer Interaction,Applications
Hybrid Influences of Social Subsystem and Technical Subsystem Risks in the Crowdsourcing Marketplace

Shan Liu,Fan Xia,Baojun Gao,Guoyin Jiang,Jinlong Zhang

DOI: https://doi.org/10.1109/tem.2019.2902446

IF: 8.702

2021-04-01

IEEE Transactions on Engineering Management

Abstract:The successful management of crowdsourcing risk has gained considerable attention because of the challenges involved in obtaining the satisfactory performance from crowdsourcing activities. However, the mechanism of how various critical risk factors affect crowdsourcing performance has been poorly investigated. Empirical evidence based on a dataset of 169 samples from China shows that three technical (i.e., complexity, requirement, and task) and three social (i.e., seeker, solver, and relationship) subsystem risks not only directly but also interactively influence the crowdsourcing task performance. Technical subsystem risk factors, while worsen performance, diminish the negative effects of social subsystem risk factors on the crowdsourcing task performance. The diminishing effects of three technical subsystem risk factors are also differentiated. High requirement and task risks lessen the negative effects of seeker, solver, and relationship risks on the task performance, whereas the high complexity risk only weakens the negative effect of the solver risk. Therefore, various crowdsourcing risk factors affect the performance in different ways and directions (either negatively or positively). Risk can perform dual roles in influencing the performance. Hybrid strategies that integrate social and technical subsystem elements may be effective in achieving a superior task performance for the crowdsourcing risk management. Managers of crowdsourcing platforms can also optimize social and technical environments to improve the fit between social and technical systems.

management,business,engineering, industrial
Extortion and Cooperation in Rating Protocol Design for Competitive Crowdsourcing.

Jianfeng Lu,Yun Xin,Zhao Zhang,Shaojie Tang,Changbing Tang,Shaohua Wan

DOI: https://doi.org/10.1109/tcss.2020.2964284

2021-01-01

IEEE Transactions on Computational Social Systems

Abstract:Although crowdsourcing has emerged as a paradigm for leveraging human intelligence and activity to solve a wide range of tasks, strategic workers will find enticement in their self-interest to free-ride and attack in a crowdsourcing contest dilemma game. Existing incentive mechanisms are not effective to avoid socially undesirable equilibrium due to the following features of competitive crowdsourcing: in the presence of imperfect monitoring, heterogeneous workers with competing interest tend to beat their opponents for larger self-profit, and the fact that they can freely and frequently change their opponents makes the situation much more complicated. Taking these features into consideration, this article proposes a mechanism design problem to enforce cooperation and extort selfish works simultaneously, with the objective of maximizing the requester's utility. To solve the problem, we integrate binary ratings with differential pricing to develop a novel rating protocol. By establishing a mathematical model for the problem and quantifying necessary and sufficient conditions for a sustainable social norm, we provide design guidelines for optimal rating protocols and design a low-complexity algorithm to select optimal design parameters. Finally, extensive evaluation results demonstrate the performance of our proposed rating protocol and reveal how intrinsic parameters impact on design parameters.
How Social Subsystem and Technical Subsystem Risks Influence Crowdsourcing Performance

Fan Xia,Shan Liu,Jinlong Zhang

2015-01-01

Abstract:Crowdsourcing is an effective and powerful tool for firms to solve practical issues and develop innovative products, but the relationship between risks and performance in crowdsourcing has received insufficient attention. Based on a dataset of 163 samples from China, social subsystem risk is empirically found to negatively influence crowdsourcing performance, whereas technical subsystem risk affects the performance insignificantly. The negative impact of social subsystem risk on performance is stronger than that of technical subsystem risk. These findings reveal that different types of risk have diverse roles in affecting performance. Moreover, we provide novel knowledge to existing literature by empirically indicating that different risk types interact with one another to influence performance. Technical subsystem risk particularly enhances the negative effect of social subsystem risk on performance. Therefore, crowdsourcers should develop systematic but different risk management strategies to mitigate the two risk types.
Task Design, Motivation, and Participation in Crowdsourcing Contests.

Haichao Zheng,Dahui Li,Wenhua Hou

DOI: https://doi.org/10.2753/jec1086-4415150402

IF: 7.73

2011-01-01

International Journal of Electronic Commerce

Abstract:Firms can seek innovative external ideas and solutions to business tasks by sponsoring co-creation activities such as crowdsourcing. To get optimal solutions from crowdsourcing contest participants, firms need to improve task design and motivate contest solvers' participation in the co-creation process. Based on the theory of extrinsic and intrinsic motivation as well as the theory of job design, we developed a research model to explain participation in crowdsourcing contests, as well as the effects of task attributes on intrinsic motivation. Subjective and objective data were collected from 283 contest solvers at two different time points. We found that intrinsic motivation was more important than extrinsic motivation in inducing participation. Contest autonomy, variety, and analyzability were positively associated with intrinsic motivation, whereas contest tacitness was negatively associated with intrinsic motivation. The findings suggest a balanced view of extrinsic and intrinsic motivation in order to encourage participation in crowdsourcing. We also suggest that crowdsourcing contest tasks should preferably be highly autonomous, explicitly specified, and less complex, as well as require a variety of skills.
Designing Socially-Optimal Rating Protocols for Crowdsourcing Contest Dilemma

Jianfeng Lu,Changbing Tang,Xiang Li,Qian Wu

DOI: https://doi.org/10.1109/tifs.2017.2656468

IF: 7.231

2017-01-01

IEEE Transactions on Information Forensics and Security

Abstract:Despite the increasing popularity and the perceived promise of crowdsourcing, its openness presents individuals with an opportunity to exhibit antisocial behavior, such as free-ride and attack to decrease the social welfare, which is considered as a crowdsourcing contest dilemma. Hence, incentive mechanisms are needed to compel rational and selfish individuals to contribute well behavior in tasks. In this paper, we integrate the pricing and reputation schemes to design a novel socially optimal rating protocol based on game theory, in which each player is tagged with a rating to represent its social status, and players are encouraged to contribute good behaviors to increase their ratings, thus receive higher rewards. In particular, we analyze how the players' behaviors are influenced by the incurred costs and the designed payment, as well as their long-term utilities. By quantifying the sufficient and necessary conditions under which all players comply with the social norm in their self-interests, we formulate the rating protocol design problem, and analyze the impacts of the design parameters in order to characterize the optimal design, that maximizes the social welfare to achieve the social optimum. Finally, illustrative results show the validity and effectiveness of our proposed protocol design for crowdsourcing contest dilemma.
Optimal Fee Structures of Crowdsourcing Platforms

Zhong Wen,Lihui Lin

DOI: https://doi.org/10.1111/deci.12201

2015-01-01

Decision Sciences

Abstract:ABSTRACTCrowdsourcing platforms specialize in hosting open contests and usually charge a percentage of the prizes as service fees. While prior research has studied the design of contests and the behavior of contestants, the strategy of a crowdsourcing platform has remained largely unexplored. We develop a game‐theoretic model of crowdsourcing services and find the optimal fee structure of a platform. We prove for the case of a single contest that the service fees should be an increasing concave function of task prizes and show that this also holds true for the case of multiple contests. We further find that for a platform with many users and tasks, there is an optimal ratio of the number of contestants and contests. Our research is one of the first to focus on the strategies of crowdsourcing platforms and our results have interesting managerial implications. We show that the linear fee schedule widely used in practice is not optimal and that a platform is better off lowering the fee rate for contests with high prizes. It is also in the best interests of a platform to develop both sides of the crowdsourcing market proportionally and keep the ratio of contestants and contests at the optimal level.
Role of Motivations, Self-Regulations, and Perceived Competitive Intensity in Solvers’ Continuance Intention in Crowdsourcing Contests

Wei Wu,Xiang Gong,Qianwen Yang

DOI: https://doi.org/10.1080/0144929x.2022.2112076

2022-01-01

Abstract:Crowdsourcing contest has emerged as an innovative way to source ideas and solutions from online public in which only the solvers who make the winning bids receive payoffs. The uncertainty of the payoffs, arising from the competitive attribute of these contests, gives rise to the necessity to understand what sustains solvers' participation. This study extends self-determination theory (SDT) to the crowdsourcing contest setting to investigate how controlled and autonomous motivation influence solver continuance intention through self-regulations (i.e. metacognitive strategies and emotion control) and when the effect of different motivation types on self-regulations are more or less prevalent. The results indicate that metacognitive strategies do mediate the relationship between motivation type and continuance intention. Meanwhile, as perceived competitive intensity increases, the positive effect of controlled motivation on metacognitive strategies is stronger but its negative effect on emotion control is also exacerbated. In addition, autonomous motivation promotes solvers' metacognitive strategies and emotion control despite the varying degrees of perceived competitive intensity. These findings offer precious managerial insights into solvers' continuance intention in crowdsourcing contests.
Tournament Based Incentive Mechanism Designs for Mobile Crowdsourcing.

Yanru Zhang,Zhu Han

DOI: https://doi.org/10.1109/glocom.2015.7417515

2017-01-01

Abstract:With the wide adoption of smart mobile devices, there is rapid development of location based services. One key feature of supporting a pleasant/excellent service is the access to adequate and comprehensive data, which can be obtained by mobile crowdsourcing. The main challenge in crowdsourcing is how the service provider (principal) incentivize a large group of mobile users to participate. In this paper, we investigate the problem of designing a tournament to provide continuous incentives for users by rewarding them based on the rank achieved in crowdsourcing. First, we model the user's utility of reward from achieving one of the winning ranks in the tournament. Then, the utility maximization problem of the principal is formulated, under the constraint that the user maximizes its own utility by choosing the optimal effort in the crowdsourcing tournament. Furthermore, we show that, the tournament can approximate the optimal contract under full information by step function. Finally, we present numerical results to compare the system performance under the different proposed incentive mechanisms; we show that by using the tournament, the users obtain the continuous incentives to participate in the crowdsourcing activity.
How crowdsourcing risks affect performance: an exploratory model

Shan Liu,Fan Xia,Jinlong Zhang,Lin Wang

DOI: https://doi.org/10.1108/MD-12-2015-0604

IF: 5.589

2016-01-01

Management Decision

Abstract:Purpose - Although crowdsourcing has gained significant attention and is being used by numerous companies to develop new products and solve practical issues, the performance of crowdsourcing is not optimistic. The purpose of this paper is to develop a validated risk profile of crowdsourcing and investigate the relationships among different types of risks and those between risks and performance in crowdsourcing. Design/methodology/approach - Based on the quantitative data collected from 136 crowdsourcing participants in China, two dimensions (i.e. social system and technical system risks) and five sub-dimensions (i.e. crowdsourcer, relationship, crowdsourcee, complexity, and requirement) of crowdsourcing risks are developed and validated. A theoretical model that integrates crowdsourcing risks and performance is developed. The technique of partial least squares is employed to assess the measurement model and test the hypotheses. Findings - The empirical evidence determines the positive association of social system risks with technical system risks, which in turn negatively affect crowdsourcing performance. Specifically, relationship risk is positively affected by crowdsourcer and crowdsourcee risks, and these risks positively affect requirement and complexity risks. However, requirement and complexity risks negatively affect crowdsourcing performance. Originality/value - This study explores the interrelationship between various risks and the relationship between risk and performance in the context of crowdsourcing by integrating risk-based view with socio-technical theory. Systematic but different risk mitigation strategies should be designed in crowdsourcing to manage risks and enhance performance.

Are Social Dominance-Based Faultlines Harmful in Crowdsourcing Tournaments?

Do Social Dominance-Based Faultlines Help or Hurt Team Performance in Crowdsourcing Tournaments?

Matchmaker: Stable Task Assignment with Bounded Constraints for Crowdsourcing Platforms

Task Assignment with Guaranteed Quality for Crowdsourcing Platforms.

An Incentive Mechanism for Crowdsourcing Systems with Network Effects

Social Sourcing: Incorporating Social Networks Into Crowdsourcing Contest Design

Task Division for Team Success in Crowdsourcing Contests: Resource Allocation and Alignment Effects

Crowdsourcing Contests: Understanding the Effect of Environment and Organization Specific Factors on Sustained Participation

Competing Openly or Blindly in Crowdsourcing Contests ?

Crowdsourcing Team Formation With Worker-Centered Modeling

Quality-Aware Incentive Mechanisms Under Social Influences in Data Crowdsourcing

Competition and Collaboration in Crowdsourcing Communities: What happens when peers evaluate each other?

Hybrid Influences of Social Subsystem and Technical Subsystem Risks in the Crowdsourcing Marketplace

Extortion and Cooperation in Rating Protocol Design for Competitive Crowdsourcing.

How Social Subsystem and Technical Subsystem Risks Influence Crowdsourcing Performance

Task Design, Motivation, and Participation in Crowdsourcing Contests.

Designing Socially-Optimal Rating Protocols for Crowdsourcing Contest Dilemma

Optimal Fee Structures of Crowdsourcing Platforms

Role of Motivations, Self-Regulations, and Perceived Competitive Intensity in Solvers’ Continuance Intention in Crowdsourcing Contests

Tournament Based Incentive Mechanism Designs for Mobile Crowdsourcing.

How crowdsourcing risks affect performance: an exploratory model