Abstract:Distributed optimization techniques offer high quality solutions to various engineering problems, such as resource allocation and distributed estimation and control. In this work, we first consider distributed convex constrained optimization problems where the objective function is encoded by multiple local and possibly nonsmooth objectives privately held by a group of agents, and propose a distributed subgradient method with double averaging (abbreviated as DSA2) that only requires peer-to-peer communication and local computation to solve the global problem. The algorithmic framework builds on dual methods and dynamic average consensus; the sequence of test points is formed by iteratively minimizing a local dual model of the overall objective where the coefficients, i.e., approximated subgradients of the objective, are supplied by the dynamic average consensus scheme. We theoretically show that DSA2 enjoys non-ergodic convergence properties, i.e., the local minimizing sequence itself is convergent, a distinct feature that cannot be found in existing results. Specifically, we establish a convergence rate of O(1t) in terms of objective function error. Then, extensions are made to tackle distributed optimization problems with coupled functional constraints by combining DSA2 and dual decomposition. This is made possible by Lagrangian relaxation that transforms the coupling in constraints of the primal problem into that in cost functions of the dual, thus allowing us to solve the dual problem via DSA2. Both the dual objective error and the quadratic penalty for the coupled constraint are proved to converge at a rate of O(1t), and the primal objective error asymptotically vanishes. Numerical experiments and comparisons are conducted to illustrate the advantage of the proposed algorithms and validate our theoretical findings.

Cooperative Distributed Optimization in Multiagent Networks with Delays

Cooperative Convex Optimization with Subgradient Delays Using Push-Sum Distributed Dual Averaging

Distributed Multi-Agent Optimization Subject to Nonidentical Constraints and Communication Delays.

Distributed optimization for multi-agent systems with constraints set and communication time-delay over a directed graph

A distributed algorithm for constrained optimization problem in multi-agent systems with communication delays

Distributed Constrained Optimization with Asynchrony and Delays

Distributed Optimization Based on a Multiagent System in the Presence of Communication Delays

Distributed Online Constrained Optimization With Feedback Delays

Push-Sum Distributed Dual Averaging for Convex Optimization in Multiagent Systems with Communication Delays

Distributed Optimization of Second-Order Nonlinear Multi-Agent Systems Subject to Communication Delays

Distributed Optimization of Multi-Agent Systems with Delayed Sampled-Data

Delay effects on distributed constrained optimization over double‐integrator multi‐agent systems

Distributed Optimization for Multi-Agent Systems with Communication Delays and External Disturbances under a Directed Network

A Generic Algorithm Framework for Distributed Optimization over the Time-Varying Network with Communication Delays

Distributed Proximal Algorithms for Multiagent Optimization With Coupled Inequality Constraints

Distributed Constrained Optimal Consensus under Fixed Time Delays

Asynchronous Distributed Nonsmooth Composite Optimization Via Computation-Efficient Primal-Dual Proximal Algorithms

Distributed Optimization of Multiagent Systems in Directed Networks with Time-Varying Delay.

Inexact Dual Averaging Method for Distributed Multi-Agent Optimization

A Unitary Distributed Subgradient Method for Multi-Agent Optimization with Different Coupling Sources

A Distributed Convex Optimization Algorithm over Directed Networks with Time Delay