Abstract:Distributed optimization enables networked agents to cooperatively solve a global optimization problem even with each participating agent only having access to a local partial view of the objective function. Despite making significant inroads, most existing results on distributed optimization rely on noise-free information sharing among the agents, which is problematic when communication channels are noisy, messages are coarsely quantized, or shared information are obscured by additive noise for the purpose of achieving differential privacy. The problem of information-sharing noise is particularly pronounced in the state-of-the-art gradient-tracking based distributed optimization algorithms, in that information-sharing noise will accumulate with iterations on the gradient-tracking estimate of these algorithms, and the ensuing variance will even grow unbounded when the noise is persistent. This paper proposes a new gradient-tracking based distributed optimization approach that can avoid information-sharing noise from accumulating in the gradient estimation. The approach is applicable even when the {inter-agent interaction is} time-varying, which is key to enable the incorporation of a decaying factor in inter-agent interaction to gradually eliminate the influence of information-sharing noise. In fact, we rigorously prove that the proposed approach can ensure the almost sure convergence of all agents to the same optimal solution even in the presence of persistent information-sharing noise. The approach is applicable to general directed graphs. It is also capable of ensuring the almost sure convergence of all agents to an optimal solution when the gradients are noisy, which is common in machine learning applications. Numerical simulations confirm the effectiveness of the proposed approach.

Quantized and Distributed Subgradient Optimization Method With Malicious Attack

A Distributed Optimization Algorithm over Markov Switching Topology under Adversarial Attack

Distributed Constrained Optimization With Delayed Subgradient Information Over Time-Varying Network Under Adaptive Quantization

Attack-Resilient Distributed Convex Optimization of Linear Multi-Agent Systems Against Malicious Cyber-Attacks over Random Digraphs

Distributed Multi-Step Subgradient Optimization for Multi-Agent System

Distributed Stochastic Algorithm for Global Optimization in Networked System

Distributed Online Optimization Under Dynamic Adaptive Quantization

Distributed Optimization with Quantized Gradient Descent

Distributed Heterogeneous Multi-Agent Optimization with Stochastic Sub-Gradient

Gradient-tracking based Distributed Optimization with Guaranteed Optimality under Noisy Information Sharing

Distributed Quasi-Newton Method for Multi-Agent Optimization

Inference Attack in Distributed Optimization via Interpolation and Manipulation

R-DOCO: Resilient Distributed Online Convex Optimization Against Adversarial Attacks

Resilient consensus-based distributed optimization under deception attacks

Distributed Subgradient Method with Random Quantization and Flexible Weights: Convergence Analysis.

Distributed Optimization via Gradient Descent with Event-Triggered Zooming over Quantized Communication

Resilient Distributed Optimization Algorithm Against Adversarial Attacks

Competition-Based Resilience in Distributed Quadratic Optimization

Distributed Quantized Optimization Design of Continuous-Time Multiagent Systems over Switching Graphs.

Distributed Stochastic Optimization With Unbounded Subgradients Over Randomly Time-Varying Networks

Distributed Algorithm for Constrained Social Cost Minimization Problem of Heterogeneous Linear Multi-Agent Systems Against DoS Attacks