Abstract:Distributed optimization techniques offer high quality solutions to various engineering problems, such as resource allocation and distributed estimation and control. In this work, we first consider distributed convex constrained optimization problems where the objective function is encoded by multiple local and possibly nonsmooth objectives privately held by a group of agents, and propose a distributed subgradient method with double averaging (abbreviated as DSA2) that only requires peer-to-peer communication and local computation to solve the global problem. The algorithmic framework builds on dual methods and dynamic average consensus; the sequence of test points is formed by iteratively minimizing a local dual model of the overall objective where the coefficients, i.e., approximated subgradients of the objective, are supplied by the dynamic average consensus scheme. We theoretically show that DSA2 enjoys non-ergodic convergence properties, i.e., the local minimizing sequence itself is convergent, a distinct feature that cannot be found in existing results. Specifically, we establish a convergence rate of O(1t) in terms of objective function error. Then, extensions are made to tackle distributed optimization problems with coupled functional constraints by combining DSA2 and dual decomposition. This is made possible by Lagrangian relaxation that transforms the coupling in constraints of the primal problem into that in cost functions of the dual, thus allowing us to solve the dual problem via DSA2. Both the dual objective error and the quadratic penalty for the coupled constraint are proved to converge at a rate of O(1t), and the primal objective error asymptotically vanishes. Numerical experiments and comparisons are conducted to illustrate the advantage of the proposed algorithms and validate our theoretical findings.

Multi-Agent Swarm Optimization with Adaptive Internal and External Learning for Complex Consensus-Based Distributed Optimization

Particle Swarm Optimization Based Leader-Follower Cooperative Control in Multi-Agent Systems

A Distributed Swarm Optimizer With Adaptive Communication for Large-Scale Optimization

Adaptive Memetic Computing for Evolutionary Multiobjective Optimization

A Multiagent Co-Evolutionary Algorithm with Penalty-Based Objective for Network-Based Distributed Optimization

A Coevolutionary Technique Based on Multi-Swarm Particle Swarm Optimization for Dynamic Multi-Objective Optimization

Evolutionary-state-driven Multi-Swarm Cooperation Particle Swarm Optimization for Complex Optimization Problem

Multi-Objective Optimization Problems Using Cooperative Evolvement Particle Swarm Optimizer

Distributed Momentum Based Multi-Agent Optimization with Different Constraint Sets

An agent-assisted heterogeneous learning swarm optimizer for large-scale optimization

Multi-objective Particle Swarm Optimization Algorithm of Multi-Swarm Co-Evolution

Distributed Constrained Optimal Consensus of Multi-Agent Systems

An adaptive particle swarm optimizer with decoupled exploration and exploitation for large scale optimization

Distributed optimization for discrete time‐varying linear multi‐agent systems with event‐triggered communication

Distributed optimization via multi-agent systems

Distributed Hybrid Optimization for Multi-Agent Systems

A Large-Scale Multiobjective Particle Swarm Optimizer With Enhanced Balance of Convergence and Diversity

Event-triggered Distributed Optimization for Model-Free Multi-Agent Systems

A Unitary Distributed Subgradient Method for Multi-Agent Optimization with Different Coupling Sources

A Distributed Parallel Cooperative Coevolutionary Multiobjective Evolutionary Algorithm for Large-Scale Optimization.

A Competitive and Cooperative Swarm Optimizer for Constrained Multiobjective Optimization Problems