Abstract:This paper investigates distributed convex optimization problems over an undirected and connected network, where each node’s variable lies in a private constrained convex set, and overall nodes aim at collectively minimizing the sum of all local objective functions. Motivated by a variety of applications in machine learning problems with large-scale training sets distributed to multiple autonomous nodes, each local objective function is further designed as the average of moderate number of local instantaneous functions. Each local objective function and constrained set cannot be shared with others. A primal-dual stochastic algorithm is presented to address the distributed convex optimization problems, where each node updates its state by resorting to unbiased stochastic averaging gradients and projects on its private constrained set. At each iteration, for each node the gradient of one local instantaneous function selected randomly is evaluated and the average of the most recent stochastic gradients is used to approximate the true local gradient. In the constrained case, we show that with strong-convexity of the local instantaneous function and Lipschitz continuity of its gradient, the algorithm converges to the global optimization solution almost surely. In the unconstrained case, an explicit linear convergence rate of the algorithm is provided. Numerical experiments are presented to demonstrate correctness of the theoretical results.

Projected Primal–Dual Dynamics for Distributed Constrained Nonsmooth Convex Optimization

Projection-based Dynamics for Distributed Optimization Subject to General Constraints

Distributed Continuous-Time Nonsmooth Convex Optimization with Coupled Inequality Constraints

Accelerated Primal-Dual Algorithms for Distributed Smooth Convex Optimization over Networks

A Proximal Algorithm for Distributed Optimization with Nonsmooth Inequality Constraints

Distributed constrained optimization for multi-agent networks with nonsmooth objective functions.

Distributed Multi-Agent Optimization with Inequality Constraints and Random Projections.

Primal-Dual Algorithm for Distributed Optimization with Coupled Constraints

Primal-dual Stochastic Distributed Algorithm for Constrained Convex Optimization

Distributed Continuous-Time Algorithm for Constrained Convex Optimizations Via Nonsmooth Analysis Approach

Distributed Continuous-Time Constrained Convex Optimization Via Nonsmooth Analysis

Distributed Proximal Algorithms for Multiagent Optimization With Coupled Inequality Constraints

A Multi-Scale Method for Distributed Convex Optimization with Constraints.

Distributed Multiproximal Algorithm for Nonsmooth Convex Optimization With Coupled Inequality Constraints

Distributed Nonsmooth Optimization with Consensus and Inequality Constraints Via Distributed Smooth Proximal-Splitting Algorithm

Primal-Dual Algorithm for Distributed Constrained Optimization

A Second Order Primal-Dual Dynamics for Set Constrained Distributed Optimization Problems

Distributed Nonsmooth Consensus Optimization Problems with Coupled Inequality Constraint: A Proximal Approach

Distributed Constrained Optimization Using a Projected Differential Inclusion

A Distributed Continuous-Time Algorithm for Nonsmooth Constrained Optimization

A projection-based continuous-time algorithm for distributed optimization over multi-agent systems