Abstract:In this article, the problem of online distributed optimization subject to a convex set is studied by employing a network of agents, where the objective functions allocated to agents are nonconvex. Each agent only has access to its own objective function information at the previous time, and can only communicate with its immediate neighbors via a time-varying directed graph. To tackle this problem, first, a new online distributed algorithm with gradient information is proposed based on consensus algorithms and projection-free strategies. Of particular interest is that dynamic regrets, whose offline benchmarks are to pursue the stationary points at each time, are employed to measure the performance of the algorithm. Under mild assumptions on the graph and the objective functions, we prove that if the deviation in the objective function sequence is sublinear with the square root of the time horizon, and if the deviation in the gradient sequence is sublinear with the time horizon, then dynamic regrets grow sublinearly. Second, considering the case where the gradient information of the objective functions is not available, we propose a zeroth-order online distributed projection-free algorithm, by which agents make decisions only depending on the random zeroth-order oracle. It turns out that under the same conditions as in the first case, if the smoothing parameters in the random zeroth-order oracles scale inversely with the time horizon, then the expectations of dynamic regrets increase sublinearly. Finally, simulations are presented to demonstrate the effectiveness of our theoretical results.

Online Distributed Constrained Optimization over General Unbalanced Digraphs

Online Distributed Optimization With Nonconvex Objective Functions Under Unbalanced Digraphs: Dynamic Regret Analysis

Privacy-Preserving Distributed Online Optimization Over Unbalanced Digraphs via Subgradient Rescaling

Primal-Dual Subgradient Algorithm for Distributed Constraint Optimization over Unbalanced Digraphs.

Distributed Randomized Gradient-Free Optimization Protocol of Multiagent Systems Over Weight-Unbalanced Digraphs

Distributed Projection Subgradient Algorithm over Time-Varying General Unbalanced Directed Graphs

Distributed Online Optimization in Time-Varying Unbalanced Networks Without Explicit Subgradients

Fully Distributed Continuous-Time Algorithm for Nonconvex Optimization Over Unbalanced Digraphs

Regularized dual gradient distributed method for constrained convex optimization over unbalanced directed graphs

Distributed Multi-Step Subgradient Optimization for Multi-Agent System

Multi-Step Subgradient Methods for Distributed Optimization over Unbalanced Digraphs with Local Constraint Sets

Online Distributed Optimization with Nonconvex Objective Functions Via Dynamic Regrets

Distributed convex optimization with a row-stochastic matrix over directed graphs

Random Sleep Scheme-Based Distributed Optimization Algorithm over Unbalanced Time-Varying Networks

Distributed Online Constrained Nonconvex Optimization in Dynamic Environments over Directed Graphs

Distributed Constrained Optimization over Unbalanced Directed Networks Using Asynchronous Broadcast-Based Algorithm.

Distributed Constrained Optimization over Unbalanced Time-Varying Digraphs: A Randomized Constraint Solving Algorithm

Distributed constrained optimization for multi-agent networks with nonsmooth objective functions.

Distributed Event-Triggered Projection Subgradient Algorithm over Unbalanced Digraphs Based on Row-Stochastic Matrices

Distributed Unbalanced Optimization Design over Nonidentical Constraints

Distributed Proximal Point Algorithm For Constrained Optimization Over Unbalanced Graphs