Abstract:Consider the consensus problem of minimizing f(x) = Sigma(n)(i=1) fi(x), where x is an element of R-p and each f(i) is only known to the individual agent i in a connected network of n agents. To solve this problem and obtain the solution, all the agents collaborate with their neighbors through information exchange. This type of decentralized computation does not need a fusion center, offers better network load balance, and improves data privacy. This paper studies the decentralized gradient descent method [A. Nedic and A. Ozdaglar, IEEE Trans. Automat. Control, 54 (2009), pp. 48-61], in which each agent i updates its local variable x((i)) is an element of R-n by combining the average of its neighbors' with a local negative-gradient step -alpha del f(i)(x((i))). The method is described by the iteration x((i)) (k + 1) <- Sigma(n)(j=1) w(ij)x((j))(k)-alpha del f(i)(x((i))(k)), for each agent i, where w(ij) is nonzero only if i and j are neighbors or i = j and the matrix W = [w(ij)] is an element of R-n (x) (n) is symmetric and doubly stochastic. This paper analyzes the convergence of this iteration and derives its rate of convergence under the assumption that each f(i) is proper closed convex and lower bounded, del f(i) is Lipschitz continuous with constant L-fi > 0, and the stepsize a is fixed. Provided that alpha <= min{(1 + lambda(n)) (W))/L-h, 1/L-(f) over bar}, where L-h = max(i){L-fi} and L-(f) over bar = (1)(n) Sigma(n)(i=1) L-fi, the objective errors of all the local solutions and the networkwide mean solution reduce at rates of O(1/k) until they reach a level of O(alpha). If fi are strongly convex with modulus mu(fi), and alpha <= min{(1+lambda(n)(W))/L-h, 1/(L-f+mu(f))}, where mu(f) - 1/n Sigma(n)(i=1) mu(fi), then all the local solutions and the mean solution converge to the global minimizer x* at a linear rate until reaching an O(alpha)-neighborhood of x*. We also develop an iteration for decentralized basis pursuit and establish its linear convergence to an O(alpha)-neighborhood of the true sparse signal. This analysis reveals how the convergence of x((i))(k + 1) <- Sigma(n)(j=1) wijx(j)(k) - alpha del f(i)(x((i))(k)), for each agent i, depends on the stepsize, function convexity, and network spectrum.

Global Optimality in Distributed Low-rank Matrix Factorization

Distributed Low-rank Matrix Factorization with Exact Consensus

The Global Geometry of Centralized and Distributed Low-rank Matrix Recovery without Regularization

Accelerated Primal-Dual Algorithms for Distributed Smooth Convex Optimization over Networks

Convergence in High Probability of Distributed Stochastic Gradient Descent Algorithms

On Nonconvex Decentralized Gradient Descent

Distributed Constrained Optimization with Linear Convergence Rate

Convergence of Distributed Adaptive Optimization with Local Updates

Convergence of Asynchronous Distributed Gradient Methods over Stochastic Networks

On the Convergence of Decentralized Gradient Descent.

Distributed Gradient Descent with Many Local Steps in Overparameterized Models

Distributed Adaptive Newton Methods with Globally Superlinear Convergence

Federated Minimax Optimization: Improved Convergence Analyses and Algorithms

On Convergence Rate of Distributed Stochastic Gradient Algorithm for Convex Optimization with Inequality Constraints.

Convergence Results of a Nested Decentralized Gradient Method for Non-strongly Convex Problems

Discrete-Time Algorithms for Distributed Constrained Convex Optimization with Linear Convergence Rates

An Accelerated Distributed Gradient Method with Local Memory

Data Dependent Convergence for Distributed Stochastic Optimization

Distributed Nonconvex Optimization: Gradient-free Iterations and $ε$-Globally Optimal Solution

Communication-Efficient Local Decentralized SGD Methods

Decentralized projected Riemannian gradient method for smooth optimization on compact submanifolds