Abstract:Crowd-selection is essential to crowdsourcing applications, since choosing the right workers with particular expertise to carry out specific crowdsourced tasks is extremely important. The central problem is simple but tricky: given a crowdsourced task, is the right worker to ask? Currently, most existing work has mainly studied the problem of crowd-selection for simple crowdsourced tasks such as decision making and sentiment analysis. Their crowd- selection procedures are based on the trustworthiness of workers. However, for some complex tasks such as document review and question answering, selecting workers based on the latent category of tasks is a better solution. In this paper, we formulate a new problem of task-driven crowd- selection for complex tasks. We first develop a bayesian gener- ative model to exploit who knows what for the workers in the crowdsourcing environment. The model provides a principle and natural framework for capturing the latent skills of workers as well as the latent categories of crowdsourced tasks. The inference of the latent skills of workers is based on past resolved crowdsourced tasks with feedback scores. We assume that the feedback scores can illustrate the performance of the workers for the tasks. We then devise a variational algorithm that transforms the latent skill infer- ence with the proposed model into a standard optimization prob- lem, which can be solved efficiently. We verify the performance of our method through extensive experiments on the data collected from three well-known crowdsourcing platforms for question an- swering tasks such as Quora, Yahoo ! Answer and Stack Overflow.

Contributors profile modelization in crowdsourcing platforms

Task Assignment with Guaranteed Quality for Crowdsourcing Platforms.

Estimation of the qualification and behavior of a contributor and aggregation of his answers in a crowdsourcing context

A Formalized Framework for Incorporating Expert Labels in Crowdsourcing Environment

Measuring the Expertise of Workers for Crowdsourcing Applications

Crowdsourcing Team Formation With Worker-Centered Modeling

Towards a characterization of crowdsourcing practices

Learning from Crowds in the Presence of Schools of Thought.

Optimal Team Recruitment Strategies for Collaborative Mobile Crowdsourcing Systems

Similarity-driven and task-driven models for diversity of opinion in crowdsourcing markets

A Conceptual Model for Participant's Motivation in Crowdsourcing Contest

Exploring the Motivation of Participants in Crowdsourcing Contest.

Crowd-Selection Query Processing in Crowdsourcing Databases: A Task-Driven Approach.

"The Whole Is Greater Than the Sum of Its Parts": Optimization in Collaborative Crowdsourcing

Multicategory Crowdsourcing Accounting for Plurality in Worker Skill and Intention, Task Difficulty, and Task Heterogeneity

Crowdsourcing as a Model for Problem Solving

Research on User Roles Identification of Crowdsourcing Innovation Virtual Community

From Social to Individuals: A Parsimonious Path of Multi-Level Models for Crowdsourced Preference Aggregation

The Importance of Being Earnest in Crowdsourcing Systems

Data Leak Aware Crowdsourcing in Social Network

A Stochastic Team Formation Approach for Collaborative Mobile Crowdsourcing