Abstract:We study a generic class of decentralized algorithms in which $N$ agents jointly optimize the non-convex objective $f(u):=1/N\sum_{i=1}^{N}f_i(u)$, while only communicating with their neighbors. This class of problems has become popular in modeling many signal processing and machine learning applications, and many efficient algorithms have been proposed. However, by constructing some counter-examples, we show that when certain local Lipschitz conditions (LLC) on the local function gradient $\nabla f_i$'s are not satisfied, most of the existing decentralized algorithms diverge, even if the global Lipschitz condition (GLC) is satisfied, where the sum function $f$ has Lipschitz gradient. This observation raises an important open question: How to design decentralized algorithms when the LLC, or even the GLC, is not satisfied? To address the above question, we design a first-order algorithm called Multi-stage gradient tracking algorithm (MAGENTA), which is capable of computing stationary solutions with neither the LLC nor the GLC. In particular, we show that the proposed algorithm converges sublinearly to certain $\epsilon$-stationary solution, where the precise rate depends on various algorithmic and problem parameters. In particular, if the local function $f_i$'s are $Q$th order polynomials, then the rate becomes $\mathcal{O}(1/\epsilon^{Q-1})$. Such a rate is tight for the special case of $Q=2$ where each $f_i$ satisfies LLC. To our knowledge, this is the first attempt that studies decentralized non-convex optimization problems with neither the LLC nor the GLC.

Decentralized Triple Proximal Splitting Algorithm with Uncoordinated Stepsizes for Nonsmooth Composite Optimization Problems

A Unified Contraction Analysis of a Class of Distributed Algorithms for Composite Optimization

Distributed Algorithms for Composite Optimization: Unified Framework and Convergence Analysis

A Unified Algorithmic Framework for Distributed Composite Optimization.

Linearized Proximal Algorithms with Adaptive Stepsizes for Convex Composite Optimization with Applications

Distributed Multiproximal Algorithm for Nonsmooth Convex Optimization With Coupled Inequality Constraints

Distributed Proximal Alternating Direction Method of Multipliers for Constrained Composite Optimization Over Directed Networks

A One-Sample Decentralized Proximal Algorithm for Non-Convex Stochastic Composite Optimization

A splitting primal-dual proximity algorithm for solving composite optimization problems

Distributed Primal-Dual Proximal Algorithms for Convex Optimization Involving Three Composite Functions

Solving a class of nonsmooth resource allocation problems with directed graphs through distributed Lipschitz continuous multi-proximal algorithms

A Forward-Backward Bregman Splitting Scheme for Regularized Distributed Optimization Problems

A Decentralized Proximal Point-type Method for Non-convex Non-concave Saddle Point Problems

Distributed continuous-time proximal algorithm for nonsmooth resource allocation problem with coupled constraints

A Smooth Double Proximal Primal-Dual Algorithm for a Class of Distributed Nonsmooth Optimization Problem

Decentralized Proximal Optimization Method with Consensus Procedure

On Convergence Rates of Linearized Proximal Algorithms for Convex Composite Optimization with Applications.

Globally-Constrained Decentralized Optimization with Variable Coupling

On the Divergence of Decentralized Non-Convex Optimization

A Proximal Gradient Method With Probabilistic Multi-Gossip Communications for Decentralized Composite Optimization

A Mixing-Accelerated Primal-Dual Proximal Algorithm for Distributed Nonconvex Optimization