Abstract:Many real-world social networks are decentralized in nature, and the only way to analyze such a network is to collect local views of the social graph from individual participants. Since local views may contain sensitive information, it is often desirable to apply differential privacy in the data collection process, which provides strong and rigorous privacy guarantees. In many practical situations, the local view of a participant contains not only her own connections, but also those of her neighbors, which are private and sensitive for the neighbors, but not directly so for the participant herself. We call such information beyond direct connections an extended local view (ELV)>, and study two fundamental problems related to ELVs: first, how do we correctly enforce differential privacy for all participants in the presence of ELVs? Second, how can the data collector utilize ELVs to obtain accurate estimates of global graph properties? This paper points out that when collecting ELVs, it is insufficient to apply a straightforward adaptation of local differential privacy (LDP)>, a commonly used scheme in practice, to protect the privacy of all network participants. The main problem is that an adversarial data collector can accumulate private information on a specific victim from multiple neighbors of the victim; even though the data collected from each neighbor is perturbed under LDP, their aggregate can still violate the victim's privacy. To prevent this attack, we formulate a novel decentralized differential privacy (DDP)> scheme, which requires that each participant consider not only her own privacy, but also that of her neighbors involved in her ELV. The stringent privacy requirement of DDP, however, makes it challenging to design an effective mechanism for data collection. Towards this goal, we design a novel multi-phase framework under DDP> that enables an analyst to accurately estimate subgraph counts, an important property of social graphs. The main idea is that instead of collecting subgraph counts directly, which would require excessively noise, the analyst first asks individuals about their respective minimum noise scale, which is private information since it depends on the local graph structure, and, thus, must be performed under DDP. For some types of subgraphs, this process is applied recursively>, i.e., the analyst asks about the necessary noise to be injected into the private information on the minimum local noise scale required to protect subgraph counts under DDP. As case studies, we instantiate the proposed framework for three common subgraph patterns: triangles, three-hop paths, and k>-cliques. Extensive experiments using real data demonstrate that the proposed scheme leads to accurate estimates of global subgraph counts, whereas baseline solutions fail to obtain meaningful result utility.

Privacy for Free: Communication-Efficient Learning with Differential Privacy Using Sketches

How to Make Private Distributed Cardinality Estimation Practical, and Get Differential Privacy for Free

PrivSketch: A Private Sketch-based Frequency Estimation Protocol for Data Streams

Private and Communication-Efficient Federated Learning based on Differentially Private Sketches

Sketching for First Order Method: Efficient Algorithm for Low-Bandwidth Channel and Vulnerability

Streaming Data Collection With a Private Sketch-Based Protocol

Distributed Differentially Private Data Analytics via Secure Sketching

Privacy-Preserving Distributed Optimization and Learning

An LDP Compatible Sketch for Securely Approximating Set Intersection Cardinalities

Sketch-Flip-Merge: Mergeable Sketches for Private Distinct Counting

M$^2$M: A general method to perform various data analysis tasks from a differentially private sketch

Differential Privacy Meets Federated Learning under Communication Constraints

A general differentially private learning framework for decentralized data

Analyzing Subgraph Statistics from Extended Local Views with Decentralized Differential Privacy.

On Privacy and Confidentiality of Communications in Organizational Graphs

Anonymous and Efficient Authentication Scheme for Privacy-Preserving Distributed Learning

DPCL: Contrastive Representation Learning with Differential Privacy

CLFLDP: Communication-efficient layer clipping federated learning with local differential privacy

Locally Differentially Private Gradient Tracking for Distributed Online Learning over Directed Graphs

Collaborative Ensemble Learning under Differential Privacy

Free Lunch for Privacy Preserving Distributed Graph Learning