Abstract:We study distributed composite optimization over networks: agents minimize a sum of smooth (strongly) convex functions, the agents' sum-utility, plus a nonsmooth (extended-valued) convex one. We propose a general unified algorithmic framework for such a class of problems and provide a unified convergence analysis leveraging the theory of operator splitting. Distinguishing features of our scheme are: (i) When the agents' functions are strongly convex, the algorithm converges at a linear rate, whose dependence on the agents' functions and network topology is decoupled, matching the typical rates of centralized optimization; the rate expression improves on existing results; (ii) When the objective function is convex (but not strongly convex), similar separation as in (i) is established for the coefficient of the proved sublinear rate; (iii) The algorithm can adjust the ratio between the number of communications and computations to achieve a rate (in terms of computations) independent on the network connectivity; and (iv) A by-product of our analysis is a tuning recommendation for several existing (non accelerated) distributed algorithms yielding the fastest provably (worst-case) convergence rate. This is the first time that a general distributed algorithmic framework applicable to composite optimization enjoys all such properties.

Distributed Asynchronous Optimization of Multiagent Systems: Convergence Analysis and Its Application

An Initialization-Free Continuous-Time Distributed Algorithm for Convex Optimization Problem

Distributed Algorithms for Composite Optimization: Unified Framework and Convergence Analysis

Distributed optimization via multi-agent systems

Augmented Distributed Gradient Methods for Multi-Agent Optimization under Uncoordinated Constant Stepsizes

A Unified Contraction Analysis of a Class of Distributed Algorithms for Composite Optimization

Distributed Multi-Step Subgradient Optimization for Multi-Agent System

A Unified Algorithmic Framework for Distributed Composite Optimization.

Distributed Stochastic Algorithm for Global Optimization in Networked System

A projection-based continuous-time algorithm for distributed optimization over multi-agent systems

Communication-efficient distributed optimization with adaptability to system heterogeneity

Distributed Online Optimization for Multi-Agent Networks With Coupled Inequality Constraints

Accelerated Distributed Aggregative Optimization

Distributed Constrained Optimization for Second-Order Multiagent Systems Via Event-Based Communication

Distributed initialization-free algorithms for multi-agent optimization problems with coupled inequality constraints

Linear Convergence of Distributed Aggregative Optimization with Coupled Inequality Constraints

Distributed Dual Subgradient Methods with Averaging and Applications to Grid Optimization

Distributed Asynchronous Discrete-Time Feedback Optimization

Distributed Optimization in Prescribed-Time: Theory and Experiment

Convergence Analysis of Dual Decomposition Algorithm in Distributed Optimization: Asynchrony and Inexactness

A distributed Newton–Raphson-based coordination algorithm for multi-agent optimization with discrete-time communication