Abstract:This article investigates distributed online convex optimization in the presence of an aggregative variable without any global/central coordinators over a multiagent network. In this problem, each individual agent is only able to access partial information of time-varying global loss functions, thus requiring local information exchanges between neighboring agents. Motivated by many applications in reality, the considered local loss functions depend not only on their own decision variables, but also on an aggregative variable, such as the average of all decision variables. To handle this problem, an online distributed gradient tracking algorithm (O-DGT) is proposed with exact gradient information and it is shown that the dynamic regret is upper bounded by three terms: 1) a sublinear term; 2) a path variation term; and 3) a gradient variation term. Meanwhile, the O-DGT algorithm is also analyzed with stochastic/noisy gradients, showing that the expected dynamic regret has the same upper bound as the exact gradient case. To our best knowledge, this article is the first to study online convex optimization in the presence of an aggregative variable, which enjoys new characteristics in comparison with the conventional scenario without the aggregative variable. Finally, a numerical experiment is provided to corroborate the obtained theoretical results.

Distributed Aggregative Optimization over Multi-Agent Networks

Distributed Multi-Step Subgradient Optimization for Multi-Agent System

Accelerated Distributed Aggregative Optimization

Distributed Stochastic Algorithm for Global Optimization in Networked System

Augmented Distributed Gradient Methods for Multi-Agent Optimization under Uncoordinated Constant Stepsizes

Distributed Online Convex Optimization with an Aggregative Variable

Distributed Aggregative Optimization via Finite-time Dynamic Average Consensus

A Unified Algorithmic Framework for Distributed Composite Optimization.

Distributed Algorithms for Composite Optimization: Unified Framework and Convergence Analysis

Distributed Heterogeneous Multi-Agent Optimization with Stochastic Sub-Gradient

A Unified Contraction Analysis of a Class of Distributed Algorithms for Composite Optimization

Distributed Consensus-Based Multi-Agent Convex Optimization Via Gradient Tracking Technique

A Neural Network for Distributed Optimization over Multiagent Networks.

A Push-Pull Gradient Method for Distributed Optimization in Networks.

Distributed Hybrid Optimization for Multi-Agent Systems

Numerical methods for distributed stochastic compositional optimization problems with aggregative structure

Distributed optimization via multi-agent systems

Distributed Online Optimization for Multi-Agent Networks With Coupled Inequality Constraints

An Algorithm for Multi-Objective Multi-Agent Optimization

Distributed Optimization for Continuous Time Multiple Agents Systems with Unknown Parameters

Distributed Optimization for Second-Order Discrete-Time Multiagent Systems with Set Constraints.