Abstract:We consider a distributed multi-agent network system where the goal is to minimize a sum of convex objective functions of the agents subject to a common convex constraint set. Each agent maintains an iterate sequence and communicates the iterates to its neighbors. Then, each agent combines weighted averages of the received iterates with its own iterate, and adjusts the iterate by using subgradient information (known with stochastic errors) of its own function and by projecting onto the constraint set. The goal of this paper is to explore the effects of stochastic subgradient errors on the convergence of the algorithm. We first consider the behavior of the algorithm in mean, and then the convergence with probability 1 and in mean square. We consider general stochastic errors that have uniformly bounded second moments and obtain bounds on the limiting performance of the algorithm in mean for diminishing and non-diminishing stepsizes. When the means of the errors diminish, we prove that there is mean consensus between the agents and mean convergence to the optimum function value for diminishing stepsizes. When the mean errors diminish sufficiently fast, we strengthen the results to consensus and convergence of the iterates to an optimal solution with probability 1 and in mean square.

Distributed Event-Triggered Projection Subgradient Algorithm over Unbalanced Digraphs Based on Row-Stochastic Matrices

Distributed Optimization For Resource Allocation With Event-Triggered Communication Under Directed Topology

A Distributed Algorithm With Event-Triggered Communication For Resource Allocation Problem

Distributed Multi-Step Subgradient Optimization for Multi-Agent System

Distributed Randomized Gradient-Free Optimization Protocol of Multiagent Systems Over Weight-Unbalanced Digraphs

A Distributed Event-Triggered Algorithm for Economic Dispatch Problem over Unbalanced Directed Network

Distributed Average Consensus with Event-Triggered in Multi-agent Systems under General Directed Topology

Distributed Stochastic Subgradient Projection Algorithms for Convex Optimization

Decentralized stochastic subgradient projection optimization algorithms over random networks

Accelerated Primal-Dual Algorithms for Distributed Smooth Convex Optimization over Networks

Distributed Heterogeneous Multi-Agent Optimization with Stochastic Sub-Gradient

Distributed optimisation for resource allocation with event-triggered communication over general directed topology

Distributed Nonsmooth Convex Optimization over Markovian Switching Random Networks with Two Step-Sizes

Distributed Stochastic Algorithm for Global Optimization in Networked System

Gradient-push algorithm for distributed optimization with event-triggered communications

A Push-Pull Gradient Method for Distributed Optimization in Networks.

A Unified Contraction Analysis of a Class of Distributed Algorithms for Composite Optimization

Regularized dual gradient distributed method for constrained convex optimization over unbalanced directed graphs

Multi-Step Subgradient Methods for Distributed Optimization over Unbalanced Digraphs with Local Constraint Sets

Distributed online constrained convex optimization with event-triggered communication

Augmented Distributed Gradient Methods for Multi-Agent Optimization under Uncoordinated Constant Stepsizes