Abstract:In this paper, we consider a class of finite-sum convex optimization problems defined over a distributed multiagent network with $m$ agents connected to a central server. In particular, the objective function consists of the average of $m$ ($\ge 1$) smooth components associated with each network agent together with a strongly convex term. Our major contribution is to develop a new randomized incremental gradient algorithm, namely, the random gradient extrapolation method (RGEM), which does not require any exact gradient evaluation even for the initial point, but can achieve the optimal ${\cal O}(\log(1/\epsilon))$ complexity bound in terms of the total number of gradient evaluations of component functions to solve the finite-sum problems. Furthermore, we demonstrate that for stochastic finite-sum optimization problems, RGEM maintains the optimal ${\cal O}(1/\epsilon)$ complexity (up to a certain logarithmic factor) in terms of the number of stochastic gradient computations, but attains an ${\cal O}(\log(1/\epsilon))$ complexity in terms of communication rounds. (Each round involves only one agent.) It is worth noting that the former bound is independent of the number of agents $m$, while the latter one only linearly depends on $m$ or even $\sqrt m$ for ill-conditioned problems. To the best of our knowledge, this is the first time that these complexity bounds have been obtained for distributed and stochastic optimization problems. Moreover, our algorithms were developed based on a novel dual perspective of Nesterov's accelerated gradient method.

A Distributed Random Projection Gradient Method for Stochastic Optimization Problems in Multi-Agent Systems

Distributed Stochastic Subgradient Projection Algorithms for Convex Optimization

Augmented Distributed Gradient Methods for Multi-Agent Optimization under Uncoordinated Constant Stepsizes

Distributed Stochastic Algorithm for Global Optimization in Networked System

Distributed Multi-Step Subgradient Optimization for Multi-Agent System

A Push-Pull Gradient Method for Distributed Optimization in Networks.

Distributed Heterogeneous Multi-Agent Optimization with Stochastic Sub-Gradient

Distributed stochastic projection-free solver for constrained optimization

Distributed Randomized Gradient-Free Optimization Protocol of Multiagent Systems Over Weight-Unbalanced Digraphs

Convergence in High Probability of Distributed Stochastic Gradient Descent Algorithms

Distributed Robust Optimization in Networked System.

Random Gradient Extrapolation for Distributed and Stochastic Optimization

Decentralized stochastic subgradient projection optimization algorithms over random networks

A projection-based continuous-time algorithm for distributed optimization over multi-agent systems

Accelerated Primal-Dual Algorithms for Distributed Smooth Convex Optimization over Networks

Distributed Riemannian Stochastic Gradient Tracking Algorithm on the Stiefel Manifold

Distributed Stochastic Block Coordinate Descent for Time-Varying Multi-Agent Optimization

A Communication-Efficient Stochastic Gradient Descent Algorithm for Distributed Nonconvex Optimization

Distributed Stochastic Optimization With Unbounded Subgradients Over Randomly Time-Varying Networks

A cutting-surface consensus approach for distributed robust optimization of multi-agent systems

Distributed proximal‐gradient algorithms for nonsmooth convex optimization of second‐order multiagent systems