Abstract:Crowd-selection is essential to crowdsourcing applications, since choosing the right workers with particular expertise to carry out specific crowdsourced tasks is extremely important. The central problem is simple but tricky: given a crowdsourced task, is the right worker to ask? Currently, most existing work has mainly studied the problem of crowd-selection for simple crowdsourced tasks such as decision making and sentiment analysis. Their crowd- selection procedures are based on the trustworthiness of workers. However, for some complex tasks such as document review and question answering, selecting workers based on the latent category of tasks is a better solution. In this paper, we formulate a new problem of task-driven crowd- selection for complex tasks. We first develop a bayesian gener- ative model to exploit who knows what for the workers in the crowdsourcing environment. The model provides a principle and natural framework for capturing the latent skills of workers as well as the latent categories of crowdsourced tasks. The inference of the latent skills of workers is based on past resolved crowdsourced tasks with feedback scores. We assume that the feedback scores can illustrate the performance of the workers for the tasks. We then devise a variational algorithm that transforms the latent skill infer- ence with the proposed model into a standard optimization prob- lem, which can be solved efficiently. We verify the performance of our method through extensive experiments on the data collected from three well-known crowdsourcing platforms for question an- swering tasks such as Quora, Yahoo ! Answer and Stack Overflow.

Linguistic Analysis of Crowd Requirements: an Experimental Study

Analysis of Requirements-Related Arguments in User Forums

Conceptualising, Extracting and Analysing Requirements Arguments in Users' Forums: the CrowdRE‐Arg Framework

A Systematic Mapping Study on Crowdsourced Requirements Engineering Using User Feedback.

Automatically Classifying User Requests in Crowdsourcing Requirements Engineering

Requirements Knowledge Acquisition from Online User Forums.

To apply Data Mining for Classification of Crowd sourced Software Requirements

Multilingual Crowd-Based Requirements Engineering Using Large Language Models

Towards Crowd-Based Requirements Engineering for Digital Farming (CrowdRE4DF)

AI based Multiagent Approach for Requirements Elicitation and Analysis

A Participant Recruitment Framework for Crowdsourcing Based Software Requirement Acquisition

Crowd-Selection Query Processing in Crowdsourcing Databases: A Task-Driven Approach.

Investigating user feedback from a crowd in requirements management in software ecosystems

Classification of Natural Language Processing Techniques for Requirements Engineering

Mining Reddit Data to Elicit Students' Requirements During COVID-19 Pandemic

Eliciting Relations from Natural Language Requirements Documents Based on Linguistic and Statistical Analysis.

Clustering Crowdsourced Test Reports of Mobile Applications Using Image Understanding

Mining Context-Aware User Requirements from Crowd Contributed Mobile Data

CrowdER: crowdsourcing entity resolution

Crowdsourcing in the Absence of Ground Truth -- A Case Study

User Story Clustering in Agile Development: a Framework and an Empirical Study