Abstract:This paper is concerned with the distributed online convex optimization problems with multiple coupled constraints over unbalanced digraphs, which are widely applied in diverse fields such as machine learning, smart grids, and resource allocation problems, etc. In such practical scenarios, multiple coupled constraints, where each coupled constraint might only contain a portion of all nodes, are more general and complex than global coupled constraints. Additionally, due to certain constraint conditions such as energy and communication limitations, each node can only exchange information with other nodes in an identical constraint. Besides, the network connectivity of practical constrained problems might not be only confined to one type of weight matrices. By adopting an augmented Lagrangian method, the multiple coupled constrained optimization problem is converted into a saddle-point problem. To tackle this problem, a novel double accelerated push-pull (DAPP) algorithm is proposed which concurrently employs row-stochastic (RS) and column-stochastic (CS) weight matrices. Specifically, each node pushes gradient information weighted by CS matrices to out-neighbors, while pulls dual variables fused by RS matrices from in-neighbors. Combined with CS matrices, the gradient tracking scheme is employed to promote the efficiency of tracking the averaged gradients. Furthermore, aiming at improving the convergence rate, the heavy-ball method is used to update both primal and dual variables. Then, rigorous theoretical results indicate that DAPP obtains the sublinear bounds of regret and constraint violation. Finally, the plug-in electric vehicles (PEVs) charging problem is utilized to demonstrate the validity of the proposed algorithm.

Distributed Computing for Huge-Scale Linear Programming

Distributed Computing for Huge-Scale Linear Programming

Scalable Distributed Least Square Algorithms for Large-Scale Linear Equations Via an Optimization Approach

A Globally Convergent Distributed Jacobi Scheme for Block-Structured Nonconvex Constrained Optimization Problems

Distributed synchronous and asynchronous algorithms for semi-definite programming with diagonal constraints

Distributed stochastic projection-free solver for constrained optimization

Distributed Algorithms for Composite Optimization: Unified Framework and Convergence Analysis

Linear Convergence of Distributed Aggregative Optimization with Coupled Inequality Constraints

Distributed cooperative optimization for multiple heterogeneous Euler-Lagrangian systems under global equality and inequality constraints

Distributed Accelerated Projection-Based Consensus Decomposition

A Distributed Algorithm for High-Dimension Convex Quadratically Constrained Quadratic Programs

Scalable Hierarchical Parallel Algorithm for the Solution of Super Large-Scale Sparse Linear Equations

Distributed Unbalanced Optimization Design over Nonidentical Constraints

Distributed Sequential Quadratic Programming with Overlapping Graph Decomposition and Exact Augmented Lagrangian

Scalable Distributed Least Squares Algorithm for Linear Algebraic Equations via Scheduling

Distributed Stochastic Algorithm for Global Optimization in Networked System

Distributed Optimization Algorithm with Superlinear Convergence Rate

A decentralized coordination algorithm for multi-objective linear programming with block angular structure

Scalable, Distributed Algorithms for Solving Linear Equations via Double-Layered Networks

Distributed Nonconvex Optimization: Gradient-free Iterations and $ε$-Globally Optimal Solution

Distributed online convex optimization with multiple coupled constraints: A double accelerated push-pull algorithm