Abstract:We present a new class of decentralized first-order methods for nonsmooth and stochastic optimization problems defined over multiagent networks. Considering that communication is a major bottleneck in decentralized optimization, our main goal in this paper is to develop algorithmic frameworks which can significantly reduce the number of inter-node communications. Our major contribution is to present a new class of decentralized primal–dual type algorithms, namely the decentralized communication sliding (DCS) methods, which can skip the inter-node communications while agents solve the primal subproblems iteratively through linearizations of their local objective functions. By employing DCS, agents can find an ϵ\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\epsilon $$\end{document}-solution both in terms of functional optimality gap and feasibility residual in O(1/ϵ)\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$${{\mathcal {O}}}(1/\epsilon )$$\end{document} (resp., O(1/ϵ)\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$${{\mathcal {O}}}(1/\sqrt{\epsilon })$$\end{document}) communication rounds for general convex functions (resp., strongly convex functions), while maintaining the O(1/ϵ2)\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$${{\mathcal {O}}}(1/\epsilon ^2)$$\end{document} (resp., O(1/ϵ)\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\mathcal{O}(1/\epsilon )$$\end{document}) bound on the total number of intra-node subgradient evaluations. We also present a stochastic counterpart for these algorithms, denoted by SDCS, for solving stochastic optimization problems whose objective function cannot be evaluated exactly. In comparison with existing results for decentralized nonsmooth and stochastic optimization, we can reduce the total number of inter-node communication rounds by orders of magnitude while still maintaining the optimal complexity bounds on intra-node stochastic subgradient evaluations. The bounds on the (stochastic) subgradient evaluations are actually comparable to those required for centralized nonsmooth and stochastic optimization under certain conditions on the target accuracy.

A Parallel Stochastic Approximation Method for Nonconvex Multi-Agent Optimization Problems

Parallel Stochastic Optimization Framework for Large-Scale Non-Convex Stochastic Problems

Stochastic Steepest-Descent Optimization Of Multiple-Objective Mobile Sensor Coverage

Online Successive Convex Approximation for Two-Stage Stochastic Nonconvex Optimization

Stochastic Successive Convex Approximation for Non-Convex Constrained Stochastic Optimization

A Unified Algorithmic Framework for Distributed Composite Optimization.

A Stochastic Multiobjective Optimization Framework for Wireless Sensor Networks

Distributed Heterogeneous Multi-Agent Optimization with Stochastic Sub-Gradient

Distributed Nonsmooth Convex Optimization over Markovian Switching Random Networks with Two Step-Sizes

Rate Analysis of Coupled Distributed Stochastic Approximation for Misspecified Optimization

An Accelerated Algorithm for Linear Quadratic Optimal Consensus of Heterogeneous Multiagent Systems.

Distributed Optimal Consensus of Multi-Agent Systems: A Randomized Parallel Approach

A Communication-Efficient Stochastic Gradient Descent Algorithm for Distributed Nonconvex Optimization

An Efficient Stochastic Algorithm for Decentralized Nonconvex-Strongly-Concave Minimax Optimization

Communication-efficient algorithms for decentralized and stochastic optimization

Distributed Stochastic Subgradient Projection Algorithms for Convex Optimization

An Efficient Distributed Parallel Algorithm for Optimal Consensus of Multi-Agent Systems

Accelerated Stochastic Algorithms for Nonconvex Finite-sum and Multi-block Optimization

Asynchronous Stochastic Proximal Methods for Nonconvex Nonsmooth Optimization.

Distributed Consensus-Based Multi-Agent Convex Optimization Via Gradient Tracking Technique

Mini-batch stochastic approximation methods for nonconvex stochastic composite optimization