Abstract:This article studies the problem of distributed optimization in multiagent systems where each agent seeks to minimize the sum of all agents' objective functions using only local information. Under the requirement of security, each agent needs to keep its objective function private from other agents and potential eavesdroppers. We first prove the impossibility of guaranteeing convergence and differential privacy simultaneously by perturbing states in exact distributed optimization algorithms. Motivated by this result, we design a completely distributed algorithm, Distributed algorithm via Direction and State Perturbation (DiaDSP), that achieves differential privacy by perturbing both states and directions with decaying Laplace noise. Different from most of the existing works that require decaying stepsizes to ensure convergence, we show that our DiaDSP algorithm converges in mean and almost surely even with a constant stepsize. In particular, we prove linear convergence in mean by only assuming that the sum of all cost functions is strongly convex. The R-linear convergence is proved under the assumption of Lipschitz gradients instead of that of bounded gradients. The optimal stepsize for the fastest convergence rate is also established. Moreover, we describe the privacy properties and characterize the tradeoff between differential privacy and convergence accuracy. Simulations are conducted on a typical sensor fusion problem to validate the theoretical results.

Privacy-Preserved Distributed Optimization for Multi-Agent Systems with Antagonistic Interactions

The Privacy-Preserving for Multi-Agent System with Antagonistic Interactions

Privacy Preservation of Optimization Algorithm over Unbalanced Directed Graph

A New Game Model for Distributed Optimization Problems with Directed Communication Topologies

A game theoretical formulation for distributed optimization problems

Distributed optimization and state based ordinal potential games

Generalized Convex Network Optimization Via Distributed Multi-Agent Dynamics

Distributed Optimization of Multiagent Systems with Preserved Network Connectivity

A Lagrange Multiplier Method for Distributed Optimization Based on Multi-Agent Network with Private and Shared Information

Cryptography-Based Privacy-Preserving Method for Distributed Optimization over Time-Varying Directed Graphs with Enhanced Efficiency

Differentially Private Distributed Optimization via State and Direction Perturbation in Multiagent Systems

Distributed Optimization of Multiagent Systems Subject to Inequality Constraints.

Privacy-Preserving Distributed Optimization Algorithm With General Local Constraints on Weight-Unbalanced Digraph

Distributed Aggregative Optimization over Multi-Agent Networks

Towards privacy-preserving cooperative control via encrypted distributed optimization

Distributed Multi-Agent Optimization Subject to Nonidentical Constraints and Communication Delays.

Distributed Online Optimization for Multi-Agent Networks With Coupled Inequality Constraints

Distributed constrained optimization for multi-agent networks with nonsmooth objective functions.

Distributed Optimization with Hybrid Linear Constraints for Multi‐agent Networks

Distributed Optimization for Second-Order Discrete-Time Multiagent Systems with Set Constraints.

Customized Local Differential Privacy for Multi-Agent Distributed Optimization