Abstract:We present a new class of decentralized first-order methods for nonsmooth and stochastic optimization problems defined over multiagent networks. Considering that communication is a major bottleneck in decentralized optimization, our main goal in this paper is to develop algorithmic frameworks which can significantly reduce the number of inter-node communications. Our major contribution is to present a new class of decentralized primal–dual type algorithms, namely the decentralized communication sliding (DCS) methods, which can skip the inter-node communications while agents solve the primal subproblems iteratively through linearizations of their local objective functions. By employing DCS, agents can find an ϵ\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\epsilon $$\end{document}-solution both in terms of functional optimality gap and feasibility residual in O(1/ϵ)\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$${{\mathcal {O}}}(1/\epsilon )$$\end{document} (resp., O(1/ϵ)\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$${{\mathcal {O}}}(1/\sqrt{\epsilon })$$\end{document}) communication rounds for general convex functions (resp., strongly convex functions), while maintaining the O(1/ϵ2)\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$${{\mathcal {O}}}(1/\epsilon ^2)$$\end{document} (resp., O(1/ϵ)\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\mathcal{O}(1/\epsilon )$$\end{document}) bound on the total number of intra-node subgradient evaluations. We also present a stochastic counterpart for these algorithms, denoted by SDCS, for solving stochastic optimization problems whose objective function cannot be evaluated exactly. In comparison with existing results for decentralized nonsmooth and stochastic optimization, we can reduce the total number of inter-node communication rounds by orders of magnitude while still maintaining the optimal complexity bounds on intra-node stochastic subgradient evaluations. The bounds on the (stochastic) subgradient evaluations are actually comparable to those required for centralized nonsmooth and stochastic optimization under certain conditions on the target accuracy.

Distributed Dual Subgradient Methods with Averaging and Applications to Grid Optimization

Distributed Dual Subgradient Methods with Averaging and Applications to Grid Optimization

Accelerated Primal-Dual Algorithms for Distributed Smooth Convex Optimization over Networks

Augmented Distributed Gradient Methods for Multi-Agent Optimization under Uncoordinated Constant Stepsizes

Distributed Multi-Step Subgradient Optimization for Multi-Agent System

Accelerating Distributed Optimization: A Primal-Dual Perspective on Local Steps

Fast distributed gradient descent method for economic dispatch of microgrids via upper bounds of second derivatives

Distributed Stochastic Subgradient Projection Algorithms for Convex Optimization

A Communication-Efficient Stochastic Gradient Descent Algorithm for Distributed Nonconvex Optimization

Distributed Algorithms for Composite Optimization: Unified Framework and Convergence Analysis

Distributed Stochastic Algorithm for Global Optimization in Networked System

Weighted matrix based distributed optimization method for economic dispatch of microgrids via multi-step gradient descent

A Coordinate Descent Primal-Dual Algorithm and Application to Distributed Asynchronous Optimization

Distributed Subgradient Method with Random Quantization and Flexible Weights: Convergence Analysis.

Distributed Successive Convex Approximation for Nonconvex Economic Dispatch in Smart Grid

Communication-efficient algorithms for decentralized and stochastic optimization

Accelerated Distributed Aggregative Optimization

Linear Convergence of Primal-Dual Gradient Methods and their Performance in Distributed Optimization

Distributed Quasi-Newton Method for Multi-Agent Optimization

Asynchronous Distributed Optimization via ADMM with Efficient Communication

Double Averaging and Gradient Projection: Convergence Guarantees for Decentralized Constrained Optimization