Abstract:We consider distributed optimization problems in which a number of agents are to seek the global optimum of a sum of cost functions through only local information sharing. In this paper, we are particularly interested in scenarios, where agents are operating asynchronously over stochastic networks subject to random failures. Most existing algorithms require coordinated and decaying stepsizes to ensure zero gap between the estimated value of each agent and the exact optimum, restricting it from asynchronous implementation and resulting in slower convergence results. To deal with this issue, we develop a new asynchronous distributed gradient method (Asyn-DGM) based on consensus theory. The proposed algorithm not only allows for asynchronous implementation in a completely distributed manner but also, most importantly, is able to seek the exact optimum even with constant stepsizes. We will show that the assumption of boundedness of gradients, which is widely used in the literature, can be dropped by instead imposing the standard Lipschitz continuity condition on gradients. Moreover, we derive an upper bound of stepsize within which the proposed AsynDGM can achieve a linear convergence rate for strongly convex functions with Lipschitz gradients. A canonical example of sensor fusion problems is provided to illustrate the effectiveness of the proposed algorithm.

An Asynchronous Gradient Descent Based Method for Distributed Resource Allocation with Bounded Variables

A Distributed Algorithm With Event-Triggered Communication For Resource Allocation Problem

A Distributed Algorithm for Resource Allocation Over Dynamic Digraphs.

A distributed algorithm with less communication for resource allocation problem

A Distributed Algorithm for Resource Allocation in Smart Grid

An Exponentially Convergent Distributed Algorithm for Resource Allocation Problem

Distributed Optimization For Resource Allocation With Event-Triggered Communication Under Directed Topology

Distributed Algorithm for a Finite Time Horizon Resource Allocation over a Directed Network

A Dual Splitting Algorithm For Distributed Resource Allocation Problems

An Expanded Distributed Algorithm for Dynamic Resource Allocation over Strongly Connected Topologies

Augmented Distributed Gradient Methods for Multi-Agent Optimization under Uncoordinated Constant Stepsizes

Distributed resource allocation: an indirect dual ascent method with an exponential convergence rate

Distributed Stochastic Algorithm for Global Optimization in Networked System

A fully distributed approach to resource allocation problem under directed and switching topologies

Distributed Adaptive Event-Triggered Algorithms for Nonsmooth Resource Allocation Optimization Over Switching Topologies

An asynchronous distributed gradient algorithm for economic dispatch over stochastic networks

A Gradient Tracking Method for Resource Allocation Base on Distributed Convex Optimization

Distributed Subgradient Algorithm for Multi-Agent Optimization with Dynamic Stepsize

Convergence in High Probability of Distributed Stochastic Gradient Descent Algorithms

Distributed optimization algorithm for multi‐agent networks with lazy gradient information

Convergence of Asynchronous Distributed Gradient Methods over Stochastic Networks