Abstract:This paper is concerned with the distributed online convex optimization problems with multiple coupled constraints over unbalanced digraphs, which are widely applied in diverse fields such as machine learning, smart grids, and resource allocation problems, etc. In such practical scenarios, multiple coupled constraints, where each coupled constraint might only contain a portion of all nodes, are more general and complex than global coupled constraints. Additionally, due to certain constraint conditions such as energy and communication limitations, each node can only exchange information with other nodes in an identical constraint. Besides, the network connectivity of practical constrained problems might not be only confined to one type of weight matrices. By adopting an augmented Lagrangian method, the multiple coupled constrained optimization problem is converted into a saddle-point problem. To tackle this problem, a novel double accelerated push-pull (DAPP) algorithm is proposed which concurrently employs row-stochastic (RS) and column-stochastic (CS) weight matrices. Specifically, each node pushes gradient information weighted by CS matrices to out-neighbors, while pulls dual variables fused by RS matrices from in-neighbors. Combined with CS matrices, the gradient tracking scheme is employed to promote the efficiency of tracking the averaged gradients. Furthermore, aiming at improving the convergence rate, the heavy-ball method is used to update both primal and dual variables. Then, rigorous theoretical results indicate that DAPP obtains the sublinear bounds of regret and constraint violation. Finally, the plug-in electric vehicles (PEVs) charging problem is utilized to demonstrate the validity of the proposed algorithm.

Push-Pull Based Distributed Primal-Dual Algorithm for Coupled Constrained Convex Optimization in Multi-Agent Networks

Primal-Dual Algorithm for Distributed Optimization with Coupled Constraints

Distributed Proximal Algorithms for Multiagent Optimization With Coupled Inequality Constraints

Primal-Dual Algorithm for Distributed Constrained Optimization

A Push-Pull Gradient Method for Distributed Optimization in Networks.

Distributed Online Optimization for Multi-Agent Networks With Coupled Inequality Constraints

Accelerated Primal-Dual Algorithms for Distributed Smooth Convex Optimization over Networks

Distributed Primal–Dual Subgradient Method for Multiagent Optimization Via Consensus Algorithms

Distributed Primal-dual Optimization for Heterogeneous Multi-agent Systems

Primal-dual Stochastic Distributed Algorithm for Constrained Convex Optimization

Regularized dual gradient distributed method for constrained convex optimization over unbalanced directed graphs

Primal-Dual Subgradient Algorithm for Distributed Constraint Optimization over Unbalanced Digraphs.

Distributed Primal-Dual Method for Convex Optimization With Coupled Constraints

Distributed primal-dual stochastic subgradient algorithms for multi-agent optimization under inequality constraints

Distributed online convex optimization with multiple coupled constraints: A double accelerated push-pull algorithm

Distributed Global Optimization for a Class of Nonconvex Optimization with Coupled Constraints

Distributed Push-Sum Algorithm for Multi-Agent Optimization Via One-Point Gradient Estimator

Distributed Optimization with Hybrid Linear Constraints for Multi‐agent Networks

Angle-Based Analysis Approach for Distributed Constrained Optimization

Primal-dual Algorithm for Distributed Optimization with Local Domains on Signed Networks

Asynchronous Distributed Nonsmooth Composite Optimization Via Computation-Efficient Primal-Dual Proximal Algorithms