Abstract:Distributed aggregative optimization (DAO) is a special class of optimization problems of networking agents where the local objective function of each agent relies on the aggregation of other agents’ decisions as well as its own. It is widely known that convergence rate is one of the most important evaluation indexes for practical applications of DAO algorithms. However, it is challenging to achieve fast convergence rate for DAO algorithms over a directed graph, owing to the fact that the underlying interaction graph may be unbalanced, and the local objective functions of individual agent depend upon the decisions of other ones. To efficiently solve the DAO problem over directed graphs, a kind of accelerated distributed optimization algorithm with Nesterov momentum and constant step-size is designed and analyzed. To handle the effect of unbalanced property of the directed networks on solving the DAO problem, a consensus iteration law is embedded into the optimization algorithm to estimate the left Perron eigenvector of the weight matrix. Furthermore, a kind of distributed aggregative gradient tracking technology associated with the Nesterov momentum coefficient is developed and employed to construct the accelerated distributed aggregative algorithm. It is theoretically shown that the proposed optimization algorithm could yield a favorable linear convergence rate after limited iterative steps when the global objective function is $\mu$ -strongly convex and $L_{1}$ -smooth. At last, numerical experiments are provided to confirm the findings.

Linear Convergence of Distributed Aggregative Optimization with Coupled Inequality Constraints

Linear Convergence for Distributed Stochastic Optimization with Coupled Inequality Constraints

Linear Convergence for Distributed Optimization Without Strong Convexity.

Distributed Optimization with Multiple Linear Equality Constraints and Convex Inequality Constraints

Primal-Dual Algorithm for Distributed Optimization with Coupled Constraints

Distributed Online Optimization for Multi-Agent Networks With Coupled Inequality Constraints

Distributed Aggregative Optimization via Finite-time Dynamic Average Consensus

Distributed Proximal Algorithms for Multiagent Optimization With Coupled Inequality Constraints

Distributed Primal-Dual Method for Convex Optimization With Coupled Constraints

Distributed Aggregative Optimization over Multi-Agent Networks

Convergence Analysis of a Distributed Optimization Algorithm with a General Unbalanced Directed Communication Network.

Distributed Constrained Optimization with Linear Convergence Rate

Continuous-Time Algorithm for Approximate Distributed Optimization with Affine Equality and Convex Inequality Constraints.

Accelerated Convergence Algorithm for Distributed Constrained Optimization under Time-Varying General Directed Graphs.

Linear Convergence of Primal-Dual Gradient Methods and their Performance in Distributed Optimization

On Convergence Rate of Distributed Stochastic Gradient Algorithm for Convex Optimization with Inequality Constraints.

Distributed Nonsmooth Consensus Optimization Problems with Coupled Inequality Constraint: A Proximal Approach

Linear convergence of a primal-dual algorithm for distributed interval optimization

Achieving Linear Convergence in Distributed Aggregative Optimization over Directed Graphs

Discrete-Time Algorithms for Distributed Constrained Convex Optimization with Linear Convergence Rates

Distributed Online Convex Optimization with Time-Varying Coupled Inequality Constraints