Abstract:Testing whether a sample survey is a credible representation of the population is an important question to ensure the validity of any downstream research. While this problem, in general, does not have an efficient solution, one might take a task-based approach and aim to understand whether a certain data analysis tool, like linear regression, would yield similar answers both on the population and the sample survey. In this paper, we design an algorithm to test the credibility of a sample survey in terms of linear regression. In other words, we design an algorithm that can certify if a sample survey is good enough to guarantee the correctness of data analysis done using linear regression tools. Nowadays, one is naturally concerned about data privacy in surveys. Thus, we further test the credibility of surveys published in a differentially private manner. Specifically, we focus on Local Differential Privacy (LDP), which is a standard technique to ensure privacy in surveys where the survey participants might not trust the aggregator. We extend our algorithm to work even when the data analysis has been done using surveys with LDP. In the process, we also propose an algorithm that learns with high probability the guarantees a linear regression model on a survey published with LDP. Our algorithm also serves as a mechanism to learn linear regression models from data corrupted with noise coming from any subexponential distribution. We prove that it achieves the optimal estimation error bound for $\ell_1$ linear regression, which might be of broader interest. We prove the theoretical correctness of our algorithms while trying to reduce the sample complexity for both public and private surveys. We also numerically demonstrate the performance of our algorithms on real and synthetic datasets.

On the dependable level of the negative survey

Estimating Positive Surveys from Negative Surveys

Fast searching optimal negative surveys

On the Reconstruction Method for Negative Surveys with Application to Education Surveys.

Reconstructing Positive Surveys From Negative Surveys With Background Knowledge

On Consistency in Multiquestion Negative Surveys with Application to Healthcare Data Collection.

Enhancing the Privacy of Negative Surveys Using Negative Combined Categories

A finite-state automata based negation detection algorithm for Chinese clinical documents

On Location and Trace Privacy of the Moving Object Using the Negative Survey

Negative Sampling in Recommendation: A Survey and Future Directions

An application of negative binomial distribution of order k in sensitive surveys

Three Branches of Negative Representation of Information: A Survey

A Privacy-Preserving Aggregation Scheme Based on Immunological Negative Surveys for Smart Meters

A Novel Negative Location Collection Method for Finding Aggregated Locations

New Insight to Preserve Online Survey Accuracy and Privacy in Big Data Era

Negative Confidence-Aware Weakly Supervised Binary Classification for Effective Review Helpfulness Classification

ABNS: Association-based negative sampling for collaborative filtering

SvdNPD: a negative data publication method based on the sensitive value distribution

Testing Credibility of Public and Private Surveys through the Lens of Regression

Negative Database for Data Security

Does Negative Sampling Matter? A Review with Insights into its Theory and Applications