Abstract:Distributed optimization enables networked agents to cooperatively solve a global optimization problem even with each participating agent only having access to a local partial view of the objective function. Despite making significant inroads, most existing results on distributed optimization rely on noise-free information sharing among the agents, which is problematic when communication channels are noisy, messages are coarsely quantized, or shared information are obscured by additive noise for the purpose of achieving differential privacy. The problem of information-sharing noise is particularly pronounced in the state-of-the-art gradient-tracking based distributed optimization algorithms, in that information-sharing noise will accumulate with iterations on the gradient-tracking estimate of these algorithms, and the ensuing variance will even grow unbounded when the noise is persistent. This paper proposes a new gradient-tracking based distributed optimization approach that can avoid information-sharing noise from accumulating in the gradient estimation. The approach is applicable even when the {inter-agent interaction is} time-varying, which is key to enable the incorporation of a decaying factor in inter-agent interaction to gradually eliminate the influence of information-sharing noise. In fact, we rigorously prove that the proposed approach can ensure the almost sure convergence of all agents to the same optimal solution even in the presence of persistent information-sharing noise. The approach is applicable to general directed graphs. It is also capable of ensuring the almost sure convergence of all agents to an optimal solution when the gradients are noisy, which is common in machine learning applications. Numerical simulations confirm the effectiveness of the proposed approach.

Compressed Gradient Tracking for Decentralized Optimization Over General Directed Networks

A Compressed Gradient Tracking Method for Decentralized Optimization With Linear Convergence

A Robust Compressed Push-Pull Method for Decentralized Nonconvex Optimization

A Linearly Convergent Robust Compressed Push-Pull Method for Decentralized Optimization

A Push-Pull Gradient Method for Distributed Optimization in Networks.

Accelerated Primal-Dual Algorithms for Distributed Smooth Convex Optimization over Networks

Compressed Gradient Tracking Algorithm for Distributed Aggregative Optimization

Compressed Gradient Tracking Algorithms for Distributed Nonconvex Optimization

Provably Accelerated Decentralized Gradient Method Over Unbalanced Directed Graphs

Provably Accelerated Decentralized Gradient Methods Over Unbalanced Directed Graphs

Balancing Communication and Computation in Gradient Tracking Algorithms for Decentralized Optimization

Compressed Differentially Private Distributed Optimization with Linear Convergence

Optimal Gradient Tracking for Decentralized Optimization

A Communication-Efficient Stochastic Gradient Descent Algorithm for Distributed Nonconvex Optimization

Distributed Algorithms for Composite Optimization: Unified Framework and Convergence Analysis

A Unified Algorithmic Framework for Distributed Composite Optimization.

A Unified Contraction Analysis of a Class of Distributed Algorithms for Composite Optimization

A Flexible Gradient Tracking Algorithmic Framework for Decentralized Optimization

Gradient-tracking based Distributed Optimization with Guaranteed Optimality under Noisy Information Sharing

A Proximal Gradient Algorithm for Composite Consensus Optimization over Directed Graphs