Abstract:We study distributed composite optimization over networks: agents minimize a sum of smooth (strongly) convex functions, the agents' sum-utility, plus a nonsmooth (extended-valued) convex one. We propose a general unified algorithmic framework for such a class of problems and provide a unified convergence analysis leveraging the theory of operator splitting. Distinguishing features of our scheme are: (i) When the agents' functions are strongly convex, the algorithm converges at a linear rate, whose dependence on the agents' functions and network topology is decoupled, matching the typical rates of centralized optimization; the rate expression improves on existing results; (ii) When the objective function is convex (but not strongly convex), similar separation as in (i) is established for the coefficient of the proved sublinear rate; (iii) The algorithm can adjust the ratio between the number of communications and computations to achieve a rate (in terms of computations) independent on the network connectivity; and (iv) A by-product of our analysis is a tuning recommendation for several existing (non accelerated) distributed algorithms yielding the fastest provably (worst-case) convergence rate. This is the first time that a general distributed algorithmic framework applicable to composite optimization enjoys all such properties.

Primal-Dual Algorithm for Distributed Optimization with Coupled Constraints

An Initialization-Free Continuous-Time Distributed Algorithm for Convex Optimization Problem

Accelerated Primal-Dual Algorithms for Distributed Smooth Convex Optimization over Networks

Distributed Online Optimization for Multi-Agent Networks With Coupled Inequality Constraints

Distributed Algorithms for Composite Optimization: Unified Framework and Convergence Analysis

Linear Convergence of Distributed Aggregative Optimization with Coupled Inequality Constraints

A Unified Algorithmic Framework for Distributed Composite Optimization.

A Unified Contraction Analysis of a Class of Distributed Algorithms for Composite Optimization

Distributed Event-Triggered Algorithm for Convex Optimization with Coupled Constraints

Asymptotic Properties of Primal-Dual Algorithm for Distributed Stochastic Optimization Over Random Networks

A Coordinate Descent Primal-Dual Algorithm and Application to Distributed Asynchronous Optimization

Distributed Robust Optimization in Networked System.

Distributed Primal-Dual Proximal Algorithms for Convex Optimization Involving Three Composite Functions

Distributed Stochastic Algorithm for Global Optimization in Networked System

Distributed Optimization of Multi-Building Energy Systems with Spatially and Temporally Coupled Constraints

Distributed initialization-free algorithms for multi-agent optimization problems with coupled inequality constraints

Communication-efficient distributed optimization with adaptability to system heterogeneity

A Smooth Double Proximal Primal-Dual Algorithm for a Class of Distributed Nonsmooth Optimization Problem

A projection-based continuous-time algorithm for distributed optimization over multi-agent systems

Primal-Dual Strategy (PDS) for Composite Optimization Over Directed graphs

Distributed online convex optimization with a bandit primal-dual mirror descent push-sum algorithm