Abstract:We study distributed multiagent optimization over (directed, time-varying) graphs. We consider the minimization of $F+G$ subject to convex constraints, where $F$ is the smooth strongly convex sum of the agent's losses and $G$ is a nonsmooth convex function. We build on the SONATA algorithm: the algorithm employs the use of surrogate objective functions in the agents' subproblems (going thus beyond linearization, such as proximal-gradient) coupled with a perturbed (push-sum) consensus mechanism that aims to track locally the gradient of $F$. SONATA achieves precision $\epsilon>0$ on the objective value in $\mathcal{O}(\kappa_g \log(1/\epsilon))$ gradient computations at each node and $\tilde{\mathcal{O}}\big(\kappa_g (1-\rho)^{-1/2} \log(1/\epsilon)\big)$ communication steps, where $\kappa_g$ is the condition number of $F$ and $\rho$ characterizes the connectivity of the network. This is the first linear rate result for distributed composite optimization; it also improves on existing (non-accelerated) schemes just minimizing $F$, whose rate depends on much larger quantities than $\kappa_g$ (e.g., the worst-case condition number among the agents). When considering in particular empirical risk minimization problems with statistically similar data across the agents, SONATA employing high-order surrogates achieves precision $\epsilon>0$ in $\mathcal{O}\big((\beta/\mu) \log(1/\epsilon)\big)$ iterations and $\tilde{\mathcal{O}}\big((\beta/\mu) (1-\rho)^{-1/2} \log(1/\epsilon)\big)$ communication steps, where $\beta$ measures the degree of similarity of the agents' losses and $\mu$ is the strong convexity constant of $F$. Therefore, when $\beta/\mu < \kappa_g$, the use of high-order surrogates yields provably faster rates than what achievable by first-order models; this is without exchanging any Hessian matrix over the network.

Distributed Multi-Step Subgradient Optimization for Multi-Agent System

Augmented Distributed Gradient Methods for Multi-Agent Optimization under Uncoordinated Constant Stepsizes

Multi-Step Subgradient Methods for Distributed Optimization over Unbalanced Digraphs with Local Constraint Sets

Observer-Based Multiagent Deep Reinforcement Learning: A Fully Distributed Training Scheme

Target-Value-Competition-Based Multi-Agent Deep Reinforcement Learning Algorithm for Distributed Nonconvex Economic Dispatch

Distributed Heterogeneous Multi-Agent Optimization with Stochastic Sub-Gradient

Distributed Randomized Gradient-Free Optimization Protocol of Multiagent Systems Over Weight-Unbalanced Digraphs

Distributed Stochastic Algorithm for Global Optimization in Networked System

Distributed Nonsmooth Convex Optimization over Markovian Switching Random Networks with Two Step-Sizes

Distributed Quasi-Newton Method for Multi-Agent Optimization

A Push-Pull Gradient Method for Distributed Optimization in Networks.

Jacobi-Style Iteration for Distributed Submodular Maximization

Accelerated Primal-Dual Algorithms for Distributed Smooth Convex Optimization over Networks

Distributed Robust Optimization in Networked System.

Distributed Dual Subgradient Methods with Averaging and Applications to Grid Optimization

Distributed optimization algorithm for multi‐agent networks with lazy gradient information

A Communication-Efficient Stochastic Gradient Descent Algorithm for Distributed Nonconvex Optimization

A distributed Newton–Raphson-based coordination algorithm for multi-agent optimization with discrete-time communication

Distributed algorithms for solving convex inequalities.

Accelerated Distributed Aggregative Optimization

Distributed Optimization Based on Gradient-tracking Revisited: Enhancing Convergence Rate via Surrogation