Abstract:Crowdsourcing offers a new way for mobilizing the collective intelligence and efforts of a large group of people to tackle tasks which cannot be efficiently performed by machines (e.g., video transcription, monitoring road conditions at specific locations) (Doan, Ramakrishnan, and Halevy 2011). Many commercial crowdsourcing platforms are now available. Their business depends on providing satisfactory services to both the crowdsourcers (i.e. task requesters) and the workers involved. From the crowdsourcers' perspective, they expect to receive high quality results for their crowd sourcing tasks in a timely manner. From the workers' perspective, they want to earn as much as possible while committing limited productive effort.As the crowdsourcers are the main source of revenue for crowdsourcing platforms, their requirements tend to take precedence over those of the workers. Many commercial crowdsourcing platforms have implemented some variants of reputation-based mechanisms (Yu et al. 2013a) to gauge the workers' competence based on their past performance, and allow only those with good reputations to access tasks.While this simple reputation-based task delegation method is intuitive and has its own merits, a different, albeit related problem, has not received much attention. As crowd sourcing workers are human beings, they have limited availability and productive capacities to work on tasks delegated to them (Yu et al. 2012). Concentrating requests to workers with good reputations may result in details. In addition, as a small portion of reputable workers become overloaded with task requests while others remain relatively idle, attrition may occur in the worker population, thereby leaving the crowdsourcing platform with a shortage of workers.The potentially conflicting objectives between crowdsourcers and workers can be formalized under the congestion game framework (Monderer and Shapley 1996). In congestion games, the payoff for each player depends on the resources it selects and the number of other players selecting the same resources. For instance, the morning commute to work places by many people can be modeled as a congestion game. The time taken by a traveller on a given day depends on how many others are taking the same route as him.

Improving Reactions to Rejection in Crowdsourcing Through Self-Reflection

Crowdsourcing Collective Emotional Intelligence

Research on the Interaction Design of Online Crowdsourcing Platform Based on Emotionality: Human Centricity.

Supporting Crowd Workers in Ideation Tasks Through Information Gathering and Reflective Activity

Understanding User Perspectives on Prompts for Brief Reflection on Troubling Emotions

A Social Mindfulness Approach to Understanding Experienced Customer Mistreatment: A Within-Person Field Experiment

A Survey of NLP-Related Crowdsourcing HITs: what works and what does not

Rejection of Unfair Offers Can Be Driven by Negative Emotions, Evidence from Modified Ultimatum Games with Anonymity.

Just the Right Mood for HIT! - Analyzing the Role of Worker Moods in Conversational Microtask Crowdsourcing.

Worker's Reward Sensitivity Predicting Motivation in Crowdsourcing: Self-Approach Achievement Goals Perspective

Competition and Collaboration in Crowdsourcing Communities: What happens when peers evaluate each other?

Investigating Crowdworkers' Identify, Perception and Practices in Micro-Task Crowdsourcing

Thumbs Up or Down: Consumer Reactions to Decisions by Algorithms Versus Humans

Crowdsourcing in the Absence of Ground Truth -- A Case Study

Infusing Human Factors Into Algorithmic Crowdsourcing

The Importance of Being Earnest in Crowdsourcing Systems

What do crowd workers think about creative work?

Getting Users Involved in Idea Crowdsourcing Initiatives: An Experimental Approach to Stimulate Intrinsic Motivation and Intention to Submit

The Emotional Roller Coaster of Responding to Requirements Changes in Software Engineering

Emotional Crowdsourcing Tool Design for Product Development: A Case Study Using Local Crowds

Rethinking the Evaluation of Dialogue Systems: Effects of User Feedback on Crowdworkers and LLMs