Abstract:This paper considers distributed online optimization with time-varying coupled inequality constraints. The global objective function is composed of local convex cost and regularization functions and the coupled constraint function is the sum of local convex functions. Adistributed online primal-dual dynamic mirror descent algorithm is proposed to solve this problem, where the local cost, regularization, and constraint functions are held privately and revealed only after each time slot. Without assuming Slater's condition, we first derive regret and constraint violation bounds for the algorithm and show how they depend on the stepsize sequences, the accumulated dynamic variation of the comparator sequence, the number of agents, and the network connectivity. As a result, under some natural decreasing stepsize sequences, we prove that the algorithm achieves sublinear dynamic regret and constraint violation if the accumulated dynamic variation of the optimal sequence also grows sublinearly. We also prove that the algorithm achieves sublinear static regret and constraint violation under mild conditions. Assuming Slater's condition, we show that the algorithm achieves smaller bounds on the constraint violation. In addition, smaller bounds on the static regret are achieved when the objective function is strongly convex. Finally, numerical simulations are provided to illustrate the effectiveness of the theoretical results.

Distributed Nonsmooth Optimization with Coupled Inequality Constraints Via Modified Lagrangian Function

Distributed Continuous-time Nonsmooth Optimization with Coupled Nonlinear Inequality Constraints

Distributed Continuous-Time Nonsmooth Convex Optimization with Coupled Inequality Constraints

A Distributed Continuous-Time Algorithm for Nonsmooth Constrained Optimization

Distributed Multiproximal Algorithm for Nonsmooth Convex Optimization With Coupled Inequality Constraints

Distributed Global Optimization for a Class of Nonconvex Optimization with Coupled Constraints

A Proximal Algorithm for Distributed Optimization with Nonsmooth Inequality Constraints

Distributed Continuous-Time Algorithm for Constrained Convex Optimizations Via Nonsmooth Analysis Approach

Distributed Nonsmooth Optimization with Different Local Constraints Via Exact Penalty

Distributed Nonsmooth Consensus Optimization Problems with Coupled Inequality Constraint: A Proximal Approach

Distributed constrained optimization for multi-agent networks with nonsmooth objective functions.

Distributed Online Convex Optimization with Time-Varying Coupled Inequality Constraints

Distributed Nonsmooth Optimization with Consensus and Inequality Constraints Via Distributed Smooth Proximal-Splitting Algorithm

Distributed Continuous-Time Constrained Convex Optimization Via Nonsmooth Analysis

Distributed Unbalanced Optimization Design over Nonidentical Constraints

Distributed Optimization with Multiple Linear Equality Constraints and Convex Inequality Constraints

Distributed cooperative optimization for multiple heterogeneous Euler-Lagrangian systems under global equality and inequality constraints

Distributed continuous-time proximal algorithm for nonsmooth resource allocation problem with coupled constraints

Distributed Online Optimization for Multi-Agent Networks With Coupled Inequality Constraints

Distributed Primal-Dual Method for Convex Optimization With Coupled Constraints

Distributed Learning with Convex SUM-of -Non-convex Objective