Abstract:This paper studies the problem of multi-agent computation under the differential privacy requirement of the agents' local datasets against eavesdroppers having node-to-node communications. We first propose for the network equipped with public-private networks. The private network is sparse and not even necessarily connected, over which communications are encrypted and secure along with the intermediate node states; the public network is connected and may be dense, over which communications are allowed to be public. In this setting, we propose a multi-gossip PPSC mechanism over the private network, where at each step, randomly selected node pairs update their states in such a way that they are shuffled with random noise while maintaining summation consistency. We show that this mechanism can achieve any desired differential privacy level with any prescribed probability. Next, we embed this mechanism in distributed computing processes, and propose privacy-guarantee protocols for three basic computation tasks, where an adaptive mechanism adjusts the amount of noise injected in PPSC steps for privacy protection, and the number of regular computation steps for accuracy guarantee. For average consensus, we develop a PPSC-Gossip averaging consensus algorithm by utilizing the multi-gossip PPSC mechanism for privacy encryption before an averaging consensus algorithm over the public network for local computations. For network linear equations and distributed convex optimization, we develop two respective distributed computing protocols by following the PPSC-Gossip averaging consensus algorithm with an additional projection or gradient descent step within each step of computation. Given any privacy and accuracy requirements, it is shown that all three proposed protocols can compute their corresponding problems with the desired computation accuracy, while achieving the desired differential privacy.

On the Capacity of Private Nonlinear Computation for Replicated Databases

Private Polynomial Computation for Noncolluding Coded Databases

Private Multiple Linear Computation: A Flexible Communication-Computation Tradeoff

Fundamental Limits of Multi-Message Private Computation

Improved Capacity Outer Bound for Private Quadratic Monomial Computation

Private Information Retrieval from Non-Replicated Databases

The Asymptotic Capacity of $X$-Secure $T$-Private Linear Computation with Graph Based Replicated Storage

The Capacity of Robust Private Information Retrieval with Colluding Databases

Differentially Private Distributed Computation via Public-Private Communication Networks

Symmetric Private Polynomial Computation From Lagrange Encoding

Private Coded Computation for Machine Learning

Distributed Algorithms that Solve Boolean Equations with Local and Differential Privacies

On the Capacity of Secure Distributed Matrix Multiplication

On the Capacity of Privacy-Preserving and Straggler-Robust Distributed Coded Computing

On Distributed Computing for Functions with Certain Structures

Distributed Differentially Private Computation of Functions with Correlated Noise

On the Fundamental Limit of Private Information Retrieval for Coded Distributed Storage

Secure Network Function Computation for Linear Functions -- Part I: Source Security

Functional Privacy for Distributed Function Computation

On the Capacity of Pairwise Collaborative Networks

Differentially Private and Communication-Efficient Distributed Nonconvex Optimization Algorithms