Abstract:We study distributed multiagent optimization over (directed, time-varying) graphs. We consider the minimization of $F+G$ subject to convex constraints, where $F$ is the smooth strongly convex sum of the agent's losses and $G$ is a nonsmooth convex function. We build on the SONATA algorithm: the algorithm employs the use of surrogate objective functions in the agents' subproblems (going thus beyond linearization, such as proximal-gradient) coupled with a perturbed (push-sum) consensus mechanism that aims to track locally the gradient of $F$. SONATA achieves precision $\epsilon>0$ on the objective value in $\mathcal{O}(\kappa_g \log(1/\epsilon))$ gradient computations at each node and $\tilde{\mathcal{O}}\big(\kappa_g (1-\rho)^{-1/2} \log(1/\epsilon)\big)$ communication steps, where $\kappa_g$ is the condition number of $F$ and $\rho$ characterizes the connectivity of the network. This is the first linear rate result for distributed composite optimization; it also improves on existing (non-accelerated) schemes just minimizing $F$, whose rate depends on much larger quantities than $\kappa_g$ (e.g., the worst-case condition number among the agents). When considering in particular empirical risk minimization problems with statistically similar data across the agents, SONATA employing high-order surrogates achieves precision $\epsilon>0$ in $\mathcal{O}\big((\beta/\mu) \log(1/\epsilon)\big)$ iterations and $\tilde{\mathcal{O}}\big((\beta/\mu) (1-\rho)^{-1/2} \log(1/\epsilon)\big)$ communication steps, where $\beta$ measures the degree of similarity of the agents' losses and $\mu$ is the strong convexity constant of $F$. Therefore, when $\beta/\mu < \kappa_g$, the use of high-order surrogates yields provably faster rates than what achievable by first-order models; this is without exchanging any Hessian matrix over the network.

Optimizing doubly stochastic matrices for average consensus through swarm and evolutionary algorithms

Improving the consensus performance via predictive mechanisms

Optimal Dynamic Average Consensus of Multi-Agent Systems

ADMM-Tracking Gradient for Distributed Optimization over Asynchronous and Unreliable Networks

Nonlinear Consensus for Distributed Optimization

Discrete-Time Matrix-Weighted Consensus

Stochastic Dynamics of Noisy Average Consensus: Analysis and Optimization

Discretized Distributed Optimization over Dynamic Digraphs

Consensus over Evolutionary Graphs

Distributed Linearized Alternating Direction Method of Multipliers for Composite Convex Consensus Optimization

Accelerated Alternating Direction Method of Multipliers Gradient Tracking for Distributed Optimization

Convergence of Asynchronous Distributed Gradient Methods over Stochastic Networks

Adaptive Consensus: A network pruning approach for decentralized optimization

Faster Convergence with Less Communication: Broadcast-Based Subgraph Sampling for Decentralized Learning over Wireless Networks

Consensus-based Distributed Optimization for Multi-agent Systems over Multiplex Networks

Distributed Optimization Based on Gradient-tracking Revisited: Enhancing Convergence Rate via Surrogation

Adaptive Consensus Gradients Aggregation for Scaled Distributed Training

Learned Finite-Time Consensus for Distributed Optimization

Distributed Real-Time Optimization Of Average Consensus

An Adaptive Stochastic Dominant Learning Swarm Optimizer for High-Dimensional Optimization

A Generalized Alternating Direction Implicit Method for Consensus Optimization: Application to Distributed Sparse Logistic Regression