Abstract:The push-sum algorithm is probably the most important distributed averaging approach over directed graphs, which has been applied to various problems including distributed optimization. This paper establishes the explicit absolute probability sequence for the push-sum algorithm, and based on which, constructs quadratic Lyapunov functions for push-sum based distributed optimization algorithms. As illustrative examples, the proposed novel analysis tool can improve the convergence rates of the subgradient-push and stochastic gradient-push, two important algorithms for distributed convex optimization over unbalanced directed graphs. Specifically, the paper proves that the subgradient-push algorithm converges at a rate of $O(1/\sqrt{t})$ for general convex functions and stochastic gradient-push algorithm converges at a rate of $O(1/t)$ for strongly convex functions, over time-varying unbalanced directed graphs. Both rates are respectively the same as the state-of-the-art rates of their single-agent counterparts and thus optimal, which closes the theoretical gap between the centralized and push-sum based (sub)gradient methods. The paper further proposes a heterogeneous push-sum based subgradient algorithm in which each agent can arbitrarily switch between subgradient-push and push-subgradient. The heterogeneous algorithm thus subsumes both subgradient-push and push-subgradient as special cases, and still converges to an optimal point at an optimal rate. The proposed tool can also be extended to analyze distributed weighted averaging.

Heterogeneous Distributed Subgradient

A Push-Pull Gradient Method for Distributed Optimization in Networks.

Distributed Heterogeneous Multi-Agent Optimization with Stochastic Sub-Gradient

Distributed Multi-Step Subgradient Optimization for Multi-Agent System

An Initialization-Free Continuous-Time Distributed Algorithm for Convex Optimization Problem

Subgradient-Push Is of the Optimal Convergence Rate

An Analysis Tool for Push-Sum Based Distributed Optimization

Distributed Subgradient Algorithm for Multi-Agent Optimization with Dynamic Stepsize

Distributed algorithms for solving convex inequalities.

Distributed Primal-dual Optimization for Heterogeneous Multi-agent Systems

Distributed quasi-monotone subgradient algorithm for nonsmooth convex optimization over directed graphs

Distributed Stochastic Subgradient Projection Algorithms for Convex Optimization

Accelerated Primal-Dual Algorithms for Distributed Smooth Convex Optimization over Networks

Distributed Stochastic Algorithm for Global Optimization in Networked System

Asynchronous Gradient-Push

Distributed algorithms for solving the convex feasibility problems

Distributed proximal‐gradient algorithms for nonsmooth convex optimization of second‐order multiagent systems

Augmented Distributed Gradient Methods for Multi-Agent Optimization under Uncoordinated Constant Stepsizes

Distributed Dual Subgradient Methods with Averaging and Applications to Grid Optimization

SUCAG: Stochastic Unbiased Curvature-aided Gradient Method for Distributed Optimization

A Communication-Efficient Stochastic Gradient Descent Algorithm for Distributed Nonconvex Optimization