Abstract:The computational bottleneck in distributed optimization methods, which is based on projected gradient descent, is due to the computation of a full gradient vector and projection step. This is a particular problem for large datasets. To reduce the computational complexity of existing methods, we combine the randomized block-coordinate descent and the Frank–Wolfe techniques, and then propose a distributed randomized block-coordinate projection-free algorithm over networks, where each agent randomly chooses a subset of the coordinates of its gradient vector and the projection step is eschewed in favor of a much simpler linear optimization step. Moreover, the convergence performance of the proposed algorithm is also theoretically analyzed. Specifically, we rigorously prove that the proposed algorithm can converge to optimal point at rate of 𝒪(1/t) under convexity and 𝒪(1/t^2) under strong convexity, respectively. Here, t is the number of iterations. Furthermore, the proposed algorithm can converge to a stationary point, where the “Frank-Wolfe” gap is equal to zero, at a rate 𝒪(1/√(t)) under non-convexity. To evaluate the computational benefit of the proposed algorithm, we use the proposed algorithm to solve the multiclass classification problems by simulation experiments on two datasets, i.e., aloi and news20. The results shows that the proposed algorithm is faster than the existing distributed optimization algorithms due to its lower computation per iteration. Furthermore, the results also show that well-connected graphs or smaller graphs leads to faster convergence rate, which can confirm the theoretical results.

Distributed Normal Map-based Stochastic Proximal Gradient Methods over Networks

A Distributed Stochastic Proximal-Gradient Algorithm for Composite Optimization

Distributed Proximal Gradient Algorithm for Nonconvex Optimization Over Time-Varying Networks

An Accelerated Distributed Stochastic Gradient Method with Momentum

Accelerated Primal-Dual Algorithms for Distributed Smooth Convex Optimization over Networks

A Push-Pull Gradient Method for Distributed Optimization in Networks.

Stochastic Gradient Tracking Methods for Distributed Personalized Optimization over Networks

A Distributed Gradient Algorithm Based on Randomized Block-Coordinate and Projection-Free over Networks

Distributed Adaptive Gradient Algorithm with Gradient Tracking for Stochastic Non-Convex Optimization

Improving the Transient Times for Distributed Stochastic Gradient Methods

Convergence in High Probability of Distributed Stochastic Gradient Descent Algorithms

Distributed Stochastic Proximal Algorithm with Random Reshuffling for Non-Smooth Finite-Sum Optimization

Convergence of Asynchronous Distributed Gradient Methods over Stochastic Networks

A Nesterov-Like Gradient Tracking Algorithm for Distributed Optimization over Directed Networks

Augmented Distributed Gradient Methods for Multi-Agent Optimization under Uncoordinated Constant Stepsizes

Distributed Stochastic Consensus Optimization With Momentum for Nonconvex Nonsmooth Problems

Convergence of a Normal Map-based Prox-SGD Method under the KL Inequality

A Decentralized Nesterov Gradient Method for Stochastic Optimization over Unbalanced Directed Networks

Decentralized Inexact Proximal Gradient Method With Network-Independent Stepsizes for Convex Composite Optimization

Decentralized stochastic subgradient projection optimization algorithms over random networks