Abstract:This paper proposes Asynchronous Triggered Gradient Tracking, i.e., a distributed optimization algorithm to solve consensus optimization over networks with asynchronous communication. As a building block, we devise the continuous-time counterpart of the recently proposed (discrete-time) distributed gradient tracking called Continuous Gradient Tracking. By using a Lyapunov approach, we prove exponential stability of the equilibrium corresponding to agents' estimates being consensual to the optimal solution, with arbitrary initialization of the local estimates. Then, we propose two triggered versions of the algorithm. In the first one, the agents continuously integrate their local dynamics and exchange with neighbors their current local variables in a synchronous way. In Asynchronous Triggered Gradient Tracking, we propose a totally asynchronous scheme in which each agent sends to neighbors its current local variables based on a triggering condition that depends on a locally verifiable condition. The triggering protocol preserves the linear convergence of the algorithm and avoids the Zeno behavior, i.e., an infinite number of triggering events over a finite interval of time is excluded. By using the stability analysis of Continuous Gradient Tracking as a preparatory result, we show exponential stability of the equilibrium point holds for both triggered algorithms and any estimate initialization. Finally, the simulations validate the effectiveness of the proposed methods on a data analytics problem, showing also improved performance in terms of inter-agent communication.

GTAdam: Gradient Tracking with Adaptive Momentum for Distributed Online Optimization

Momentum-based Distributed Gradient Tracking Algorithms for Distributed Aggregative Optimization over Unbalanced Directed Graphs

Optimized Gradient Tracking for Decentralized Online Learning

ADMM-Tracking Gradient for Distributed Optimization over Asynchronous and Unreliable Networks

DADAM: A Consensus-based Distributed Adaptive Gradient Method for Online Optimization

Accelerated Alternating Direction Method of Multipliers Gradient Tracking for Distributed Optimization

Augmented Distributed Gradient Methods for Multi-Agent Optimization under Uncoordinated Constant Stepsizes

An Accelerated Distributed Stochastic Gradient Method with Momentum

Accelerating Gradient Tracking with Periodic Global Averaging

Triggered Gradient Tracking for Asynchronous Distributed Optimization

Distributed Adaptive Gradient Algorithm with Gradient Tracking for Stochastic Non-Convex Optimization

A Distributed Stochastic Optimization Algorithm with Gradient-Tracking and Distributed Heavy-Ball Acceleration

Distributed Second-Order Continuous-Time Optimization Via Adaptive Algorithm with Nonuniform Gradient Gains

An Accelerated Gradient Tracking Algorithm with Projection Error for Distributed Optimization.

Adam: A Method for Stochastic Optimization

Distributed Stochastic Consensus Optimization With Momentum for Nonconvex Nonsmooth Problems

Distributed Consensus-Based Multi-Agent Convex Optimization Via Gradient Tracking Technique

Distributed Stochastic Gradient Tracking Algorithm with Variance Reduction for Non-Convex Optimization

Distributed Conjugate Gradient Method via Conjugate Direction Tracking