Abstract:The problem of crowdsourced entity collection solicits people (a.k.a. workers) to complete missing data in a database and has witnessed many applications in knowledge base completion and enterprise data collection. Although previous studies have attempted to address the "open world" challenge of crowdsourced entity collection, they do not pay much attention to the "distribution" of the collected entities. Evidently, in many real applications, users may have distribution requirements on the collected entities, e.g., even spatial distribution when collecting points-of-interest. In this paper, we study a new research problem, distribution-aware crowdsourced entity collection (CROWDDEC): Given an expected distribution w.r.t. an attribute (e.g., region or year), it aims to collect a set of entities via crowdsourcing and minimize the difference of the entity distribution from the expected distribution. Due to the openness of crowdsourcing, the CROWDDEC problem calls for effective crowdsourcing quality control. We propose an adaptive worker selection approach to address this problem. The approach estimates underlying entity distribution of workers on-the-fly based on the collected entities. Then, it adaptively selects the best set of workers that minimizes the difference from the expected distribution. Once workers submit their answers, it adjusts the estimation of workers' underlying distributions for subsequent adaptive worker selections. We prove the hardness of the problem, and develop effective estimation techniques as well as efficient worker selection algorithms to support this approach. We deployed the proposed approach on Amazon Mechanical Turk and the experimental results on two real datasets show that the approach achieves superiority on both effectiveness and efficiency.

Range Query Estimation for Dirty Data Management System.

Efficient Histogram-Based Range Query Estimation for Dirty Data

Assessing Data Quality Within Available Context

Automatic Accuracy Assessment Via Hashing in Multiple-Source Environment

Assessing Accuracy with Locality-Sensitive Hashing in Multiple Source Environment.

Query Processing Based On Entity Resolution

Compressed Histogram Based Similarity Join Size Estimation for Dirty Database

EntityManager: Managing Dirty Data Based on Entity Resolution.

Dirty Data Management In Cloud Database

EntityManager: An Entity-Based Dirty Data Management System

Processing probabilistic range query over imprecise data based on quality of result

An Aggregation Query Processing Method of Dirty Database Based on Clustering

Selectivity Estimation by Batch-Query Based Histogram and Parametric Method.

Impacts of Dirty Data: and Experimental Evaluation

Impacts of Dirty Data on Classification and Clustering Models: an Experimental Evaluation.

Distribution-Aware Crowdsourced Entity Collection

Remember The Past: Self-Tuning Histograms Based On Query-Feedback Logs

Error Minimization in Approximate Range Aggregates

Aggregate Query Processing on Incomplete Data

Relative Accuracy Evaluation

Selecting Sources for Query Approximation with Bounded Resources.