Abstract:We present a new class of decentralized first-order methods for nonsmooth and stochastic optimization problems defined over multiagent networks. Considering that communication is a major bottleneck in decentralized optimization, our main goal in this paper is to develop algorithmic frameworks which can significantly reduce the number of inter-node communications. Our major contribution is to present a new class of decentralized primal–dual type algorithms, namely the decentralized communication sliding (DCS) methods, which can skip the inter-node communications while agents solve the primal subproblems iteratively through linearizations of their local objective functions. By employing DCS, agents can find an ϵ\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\epsilon $$\end{document}-solution both in terms of functional optimality gap and feasibility residual in O(1/ϵ)\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$${{\mathcal {O}}}(1/\epsilon )$$\end{document} (resp., O(1/ϵ)\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$${{\mathcal {O}}}(1/\sqrt{\epsilon })$$\end{document}) communication rounds for general convex functions (resp., strongly convex functions), while maintaining the O(1/ϵ2)\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$${{\mathcal {O}}}(1/\epsilon ^2)$$\end{document} (resp., O(1/ϵ)\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\mathcal{O}(1/\epsilon )$$\end{document}) bound on the total number of intra-node subgradient evaluations. We also present a stochastic counterpart for these algorithms, denoted by SDCS, for solving stochastic optimization problems whose objective function cannot be evaluated exactly. In comparison with existing results for decentralized nonsmooth and stochastic optimization, we can reduce the total number of inter-node communication rounds by orders of magnitude while still maintaining the optimal complexity bounds on intra-node stochastic subgradient evaluations. The bounds on the (stochastic) subgradient evaluations are actually comparable to those required for centralized nonsmooth and stochastic optimization under certain conditions on the target accuracy.

Distributed optimization algorithm for multi‐agent networks with lazy gradient information

A Push-Pull Gradient Method for Distributed Optimization in Networks.

Distributed Multi-Step Subgradient Optimization for Multi-Agent System

Distributed Stochastic Algorithm for Global Optimization in Networked System

A Communication-Efficient Stochastic Gradient Descent Algorithm for Distributed Nonconvex Optimization

Distributed Subgradient Algorithm for Multi-Agent Optimization with Dynamic Stepsize

Augmented Distributed Gradient Methods for Multi-Agent Optimization under Uncoordinated Constant Stepsizes

Distributed Heterogeneous Multi-Agent Optimization with Stochastic Sub-Gradient

Accelerated Primal-Dual Algorithms for Distributed Smooth Convex Optimization over Networks

Gradient-tracking based Distributed Optimization with Guaranteed Optimality under Noisy Information Sharing

Distributed Nonsmooth Convex Optimization over Markovian Switching Random Networks with Two Step-Sizes

Distributed Randomized Gradient-Free Optimization Protocol of Multiagent Systems Over Weight-Unbalanced Digraphs

Distributed Optimization in Multi-agent Networks Using One-bit of Relative State Information

Distributed Discrete-Time Optimization in Multiagent Networks Using Only Sign of Relative State

An Asynchronous Gradient Descent Based Method for Distributed Resource Allocation with Bounded Variables

Communication-efficient distributed optimization with adaptability to system heterogeneity

Distributed Discrete-time Optimization in Multi-agent Networks Using only Sign of Relative State

Distributed Proximal Gradient Algorithm for Nonconvex Optimization Over Time-Varying Networks

A distributed Newton–Raphson-based coordination algorithm for multi-agent optimization with discrete-time communication

Communication-efficient algorithms for decentralized and stochastic optimization

An Accelerated Gossip-Based Distributed Gradient Method