Abstract:The correlations and network structure amongst individuals in datasets today---whether explicitly articulated, or deduced from biological or behavioral connections---pose new issues around privacy guarantees, because of inferences that can be made about one individual from another's data. This motivates quantifying privacy in networked contexts in terms of "inferential privacy"---which measures the change in beliefs about an individual's data from the result of a computation---as originally proposed by Dalenius in the 1970's. Inferential privacy is implied by differential privacy when data are independent, but can be much worse when data are correlated; indeed, simple examples, as well as a general impossibility theorem of Dwork and Naor, preclude the possibility of achieving non-trivial inferential privacy when the adversary can have arbitrary auxiliary information. In this paper, we ask how differential privacy guarantees translate to guarantees on inferential privacy in networked contexts: specifically, under what limitations on the adversary's information about correlations, modeled as a prior distribution over datasets, can we deduce an inferential guarantee from a differential one? We prove two main results. The first result pertains to distributions that satisfy a natural positive-affiliation condition, and gives an upper bound on the inferential privacy guarantee for any differentially private mechanism. This upper bound is matched by a simple mechanism that adds Laplace noise to the sum of the data. The second result pertains to distributions that have weak correlations, defined in terms of a suitable "influence matrix". The result provides an upper bound for inferential privacy in terms of the differential privacy parameter and the spectral norm of this matrix.

Differentially private estimation in a class of directed network models

Differential privacy statistical inference for a directed graph network model with covariates

Asymptotics in the Bradley-Terry model for networks with a differentially private degree sequence

Inference using noisy degrees: Differentially private $β$-model and synthetic graphs

Edge differentially private estimation in the $β$-model via jittering and method of moments

Differentially Private Model Selection with Penalized and Constrained Likelihood

Sharing Social Network Data: Differentially Private Estimation of Exponential-Family Random Graph Models

Sharper Utility Bounds for Differentially Private Models: Smooth and Non-smooth

Differentially Private Distributed Estimation and Learning

On Learning Cluster Coefficient of Private Networks

Differentially Private Variational Inference for Non-conjugate Models

Differentially Private Nash Equilibrium Seeking in Quadratic Network Games

Inferential Privacy Guarantees for Differentially Private Mechanisms

Differentially private regression analysis with dynamic privacy allocation

Private Estimation and Inference in High-Dimensional Regression with FDR Control

Differentially Private Bipartite Consensus over Signed Networks with Time-Varying Noises

Asymptotic in a class of network models with an increasing sub-Gamma degree sequence

Tailoring Differentially Private Bayesian Inference to Distance Between Distributions

Differentially private sub-Gaussian location estimators

Differentially Private Distributed Bayesian Linear Regression with MCMC

PrIsing: Privacy-Preserving Peer Effect Estimation via Ising Model