Abstract:Crowdsensing has been recognized as a promising data collection paradigm, in which a platform outsources sensing tasks to a large number of users. However, requesting users to report raw data may give rise to many practical concerns, such as a significant overhead of communication and central processing, besides users' privacy concerns. In many scenarios (e.g, advertising and recommendation), the data collector directly benefits from statistical aggregation of raw data. Thus motivated, we consider the data collection problem based on user's local histograms, which is intimately related to the fundamental trade-off between the platform's accuracy and users' privacy. Because of users' social relationship, their data are often correlated, indicating that users' privacy may be leaked from others' data. To tackle this challenge, we first utilize Gaussian Markov random fields to model the correlation structure embedded in users' data. The data collection is modeled as a Stackelberg game where the platform decides its reward policy and users decide their noise levels while taking into account the social coupling among users. For the reward policy design, we first establish the relationship between users' Nash equilibrium and the payment mechanism, and then optimize the platform's accuracy under a budget constraint. Further, since the noise levels are users' private information, they may use falsified noise levels to achieve higher payoffs, which in turn impairs the crowdsensing performance. It turns out that with the insight into the correlation structure among users' data, the information asymmetry can be overcome based on peer prediction. We revisit the payment mechanism to guarantee dominant truthfulness of each user's strategy. Theoretical analysis and numerical results demonstrate the effectiveness of the proposed mechanism.

Crowd & Prejudice: An Impossibility Theorem for Crowd Labelling without a Gold Standard

A Formalized Framework for Incorporating Expert Labels in Crowdsourcing Environment

Learning from Crowds under Experts' Supervision

Socially Privacy-Preserving Data Collection for Crowdsensing

Learning from Crowds in the Presence of Schools of Thought.

Collusion Detection and Ground Truth Inference in Crowdsourcing for Labeling Tasks.

Subjective Crowd Disagreements for Subjective Data: Uncovering Meaningful CrowdOpinion with Population-level Learning

Uncovering the Latent Structures of Crowd Labeling.

The Effect of Class Imbalance and Order on Crowdsourced Relevance Judgments

Max-MIG: an Information Theoretic Approach for Joint Learning from Crowds

Avoiding Imposters and Delinquents: Adversarial Crowdsourcing and Peer Prediction

Measuring Social Biases of Crowd Workers using Counterfactual Queries

Mechanisms for Making Crowds Truthful

Privacy-Aware Crowd Labelling for Machine Learning Tasks

Crowdsourcing Label Quality: A Theoretical Analysis

Deep Bayesian Trust : A Dominant and Fair Incentive Mechanism for Crowd

Label Consistency-Based Ground Truth Inference for Crowdsourcing

Resolving the Human Subjects Status of Machine Learning's Crowdworkers

Optimal Stopping and Worker Selection in Crowdsourcing: an Adaptive Sequential Probability Ratio Test Framework

A Turing test for crowds

Fairness and Bias in Truth Discovery Algorithms: An Experimental Analysis