Abstract:Many real-world social networks are decentralized in nature, and the only way to analyze such a network is to collect local views of the social graph from individual participants. Since local views may contain sensitive information, it is often desirable to apply differential privacy in the data collection process, which provides strong and rigorous privacy guarantees. In many practical situations, the local view of a participant contains not only her own connections, but also those of her neighbors, which are private and sensitive for the neighbors, but not directly so for the participant herself. We call such information beyond direct connections an extended local view (ELV)>, and study two fundamental problems related to ELVs: first, how do we correctly enforce differential privacy for all participants in the presence of ELVs? Second, how can the data collector utilize ELVs to obtain accurate estimates of global graph properties? This paper points out that when collecting ELVs, it is insufficient to apply a straightforward adaptation of local differential privacy (LDP)>, a commonly used scheme in practice, to protect the privacy of all network participants. The main problem is that an adversarial data collector can accumulate private information on a specific victim from multiple neighbors of the victim; even though the data collected from each neighbor is perturbed under LDP, their aggregate can still violate the victim's privacy. To prevent this attack, we formulate a novel decentralized differential privacy (DDP)> scheme, which requires that each participant consider not only her own privacy, but also that of her neighbors involved in her ELV. The stringent privacy requirement of DDP, however, makes it challenging to design an effective mechanism for data collection. Towards this goal, we design a novel multi-phase framework under DDP> that enables an analyst to accurately estimate subgraph counts, an important property of social graphs. The main idea is that instead of collecting subgraph counts directly, which would require excessively noise, the analyst first asks individuals about their respective minimum noise scale, which is private information since it depends on the local graph structure, and, thus, must be performed under DDP. For some types of subgraphs, this process is applied recursively>, i.e., the analyst asks about the necessary noise to be injected into the private information on the minimum local noise scale required to protect subgraph counts under DDP. As case studies, we instantiate the proposed framework for three common subgraph patterns: triangles, three-hop paths, and k>-cliques. Extensive experiments using real data demonstrate that the proposed scheme leads to accurate estimates of global subgraph counts, whereas baseline solutions fail to obtain meaningful result utility.

Privacy-Utility Trade-offs in Neural Networks for Medical Population Graphs: Insights from Differential Privacy and Graph Structure

Local Differential Privacy in Graph Neural Networks: a Reconstruction Approach

A Random Matrix Approach to Differential Privacy and Structure Preserved Social Network Graph Publishing

GraphPub: Generation of Differential Privacy Graph with High Availability

Releasing Graph Neural Networks with Differential Privacy Guarantees

PrivGraph: Differentially Private Graph Data Publication by Exploiting Community Information

On Learning Cluster Coefficient of Private Networks

Community-Preserving Social Graph Release with Node Differential Privacy

Training Differentially Private Graph Neural Networks with Random Walk Sampling

Bridging the Gap: Differentially Private Equivariant Deep Learning for Medical Image Analysis

Not one but many Tradeoffs: Privacy Vs. Utility in Differentially Private Machine Learning

Medical imaging deep learning with differential privacy

Differentially Private Client Selection and Resource Allocation in Federated Learning for Medical Applications Using Graph Neural Networks

Chasing Your Long Tails: Differentially Private Prediction in Health Care Settings

Differential Privacy Meets Neural Network Pruning

Sharing Social Network Data: Differentially Private Estimation of Exponential-Family Random Graph Models

Privacy-Preserving Graph Embedding based on Local Differential Privacy

Differential Privacy on Trust Graphs

Analyzing Subgraph Statistics from Extended Local Views with Decentralized Differential Privacy.

Towards Private Learning on Decentralized Graphs With Local Differential Privacy

Edge Private Graph Neural Networks with Singular Value Perturbation