Abstract:We study distributed composite optimization over networks: agents minimize a sum of smooth (strongly) convex functions, the agents' sum-utility, plus a nonsmooth (extended-valued) convex one. We propose a general unified algorithmic framework for such a class of problems and provide a unified convergence analysis leveraging the theory of operator splitting. Distinguishing features of our scheme are: (i) When the agents' functions are strongly convex, the algorithm converges at a linear rate, whose dependence on the agents' functions and network topology is decoupled, matching the typical rates of centralized optimization; the rate expression improves on existing results; (ii) When the objective function is convex (but not strongly convex), similar separation as in (i) is established for the coefficient of the proved sublinear rate; (iii) The algorithm can adjust the ratio between the number of communications and computations to achieve a rate (in terms of computations) independent on the network connectivity; and (iv) A by-product of our analysis is a tuning recommendation for several existing (non accelerated) distributed algorithms yielding the fastest provably (worst-case) convergence rate. This is the first time that a general distributed algorithmic framework applicable to composite optimization enjoys all such properties.

Distributed constrained optimization for multi-agent networks with nonsmooth objective functions.

An Initialization-Free Continuous-Time Distributed Algorithm for Convex Optimization Problem

Distributed initialization-free algorithms for multi-agent optimization problems with coupled inequality constraints

Distributed Algorithms for Composite Optimization: Unified Framework and Convergence Analysis

A Unified Contraction Analysis of a Class of Distributed Algorithms for Composite Optimization

A Unified Algorithmic Framework for Distributed Composite Optimization.

Distributed Online Optimization for Multi-Agent Networks With Coupled Inequality Constraints

Distributed Stochastic Algorithm for Global Optimization in Networked System

Distributed Continuous-Time Algorithm for Constrained Optimization of Networked Euler–Lagrange Systems

A projection-based continuous-time algorithm for distributed optimization over multi-agent systems

Distributed Robust Optimization in Networked System.

Distributed Multiproximal Algorithm for Nonsmooth Convex Optimization With Coupled Inequality Constraints

Distributed Optimization for Continuous Time Multiple Agents Systems with Unknown Parameters

Distributed discrete-time optimization of heterogeneous multi-agent networks with unbounded position constraints and nonconvex velocity constraints

Regularized dual gradient distributed method for constrained convex optimization over unbalanced directed graphs

Distributed Optimization for Second-Order Discrete-Time Multiagent Systems with Set Constraints.

A scaling-function approach for distributed constrained optimization in unbalanced multi-agent networks

Distributed proximal‐gradient algorithms for nonsmooth convex optimization of second‐order multiagent systems

Distributed cooperative optimization for multiple heterogeneous Euler-Lagrangian systems under global equality and inequality constraints

Distributed continuous-time proximal algorithm for nonsmooth resource allocation problem with coupled constraints

Neurodynamic approaches for multi-agent distributed optimization