Abstract:In recent years, there has been a growing interest in distributed optimization, which collaboratively attains an optimum by exchanging information with neighbours. Among the various distributed algorithms available, optimization with gradient tracking is particularly notable for its superior convergence results, especially in the context of directed graphs. However, privacy concerns arise when gradient information is transmitted directly which would induce more information leakage. Surprisingly, the literature has not adequately addressed the associated privacy issues. In response to the gap, our paper proposes a privacy-preserving distributed optimization algorithm with gradient tracking by adding noises to transmitted messages, namely, the decision variables and the estimate of the aggregated gradient. We prove two dilemmas for this kind of algorithm. In the first dilemma, we reveal that this distributed optimization algorithm with gradient tracking cannot achieve $ \epsilon$-differential privacy (DP) and exact convergence simultaneously. Building on this, we subsequently highlight that the algorithm fails to achieve $ \epsilon$-DP when employing non-summable stepsizes in the presence of Laplace noises. It is crucial to emphasize that these findings hold true regardless of the size of the privacy metric $ \epsilon$. After that, we rigorously analyse the convergence performance and privacy level given summable stepsize sequences under Laplace distribution since it is only with summable stepsizes that is meaningful for us to study. We derive sufficient conditions that allow for the simultaneous stochastically bounded accuracy and $ \epsilon$-DP. Recognizing that several options can meet these conditions, we further derive an upper bound of the mean error's variance and specify the mathematical expression of $ \epsilon$ under such conditions. Numerical simulations are provided to demonstrate the effectiveness of our proposed algorithm.

Differentially Private Distributed Algorithms for Aggregative Games with Directed Communication Graphs

Differentially-private Distributed Algorithms for Aggregative Games with Guaranteed Convergence

Differentially private Nash equilibrium seeking for networked aggregative games

Differentially Private Nash Equilibrium Seeking in Quadratic Network Games

Compression-based Privacy Preservation for Distributed Nash Equilibrium Seeking in Aggregative Games

Distributed adaptive generalized Nash equilibrium seeking algorithm with event‐triggered communication

Communication-efficient and Differentially-private Distributed Nash Equilibrium Seeking with Linear Convergence

Ensure Differential Privacy and Convergence Accuracy in Consensus Tracking and Aggregative Games with Coupling Constraints

Differentially Private Distributed Resource Allocation Via Deviation Tracking

Distributed Generalized Nash Equilibrium Seeking Algorithm Design for Aggregative Games Over Weight-Balanced Digraphs

Distributed Nash Equilibrium Seeking for Aggregative Games With Nonlinear Dynamics Under External Disturbances

Privacy-Accuracy Trade-Off in Differentially-Private Distributed Classification: A Game Theoretical Approach

Distributed Least-Squares Optimization Solvers with Differential Privacy

Differentially Private Dual Gradient Tracking for Distributed Resource Allocation

Distributed Generalized Nash Equilibria Seeking Algorithms Involving Synchronous and Asynchronous Schemes

Differentially Private and Communication-Efficient Distributed Nonconvex Optimization Algorithms

Tracking-Based Distributed Equilibrium Seeking for Aggregative Games

Tailoring Gradient Methods for Differentially-Private Distributed Optimization

Differential Privacy in Distributed Optimization with Gradient Tracking

Distributed Algorithms for Searching Generalized Nash Equilibrium of Noncooperative Games.