Abstract:We study distributed composite optimization over networks: agents minimize a sum of smooth (strongly) convex functions, the agents' sum-utility, plus a nonsmooth (extended-valued) convex one. We propose a general unified algorithmic framework for such a class of problems and provide a unified convergence analysis leveraging the theory of operator splitting. Distinguishing features of our scheme are: (i) When the agents' functions are strongly convex, the algorithm converges at a linear rate, whose dependence on the agents' functions and network topology is decoupled, matching the typical rates of centralized optimization; the rate expression improves on existing results; (ii) When the objective function is convex (but not strongly convex), similar separation as in (i) is established for the coefficient of the proved sublinear rate; (iii) The algorithm can adjust the ratio between the number of communications and computations to achieve a rate (in terms of computations) independent on the network connectivity; and (iv) A by-product of our analysis is a tuning recommendation for several existing (non accelerated) distributed algorithms yielding the fastest provably (worst-case) convergence rate. This is the first time that a general distributed algorithmic framework applicable to composite optimization enjoys all such properties.

An Initialization-Free Continuous-Time Distributed Algorithm for Convex Optimization Problem

Fully Distributed Continuous-Time Algorithm for Nonconvex Optimization Over Unbalanced Digraphs

An Exponentially Convergent Distributed Algorithm for Resource Allocation Problem

Distributed initialization-free algorithms for multi-agent optimization problems with coupled inequality constraints

A projection-based continuous-time algorithm for distributed optimization over multi-agent systems

Distributed Stochastic Algorithm for Global Optimization in Networked System

Averaging Approach to Distributed Convex Optimization for Continuous-Time Multi-Agent Systems

An Adaptive Penalty-like Continuous-Time Algorithm to Constrained Distributed Convex Optimization

Distributed Finite‐time Optimization Algorithms for Multi‐agent Systems under Directed Graphs

Distributed Algorithms for Composite Optimization: Unified Framework and Convergence Analysis

Distributed Convex Nonsmooth Optimization For Multi-Agent System Based On Proximal Operator

A distributed Newton–Raphson-based coordination algorithm for multi-agent optimization with discrete-time communication

A Multi-Scale Method for Distributed Convex Optimization with Constraints.

A Unified Algorithmic Framework for Distributed Composite Optimization.

Distributed algorithms for solving convex inequalities.

A Unified Contraction Analysis of a Class of Distributed Algorithms for Composite Optimization

A Continuous-Time Neurodynamic Approach and Its Discretization for Distributed Convex Optimization over Multi-Agent Systems

A Power Reformulation Continuous-Time Algorithm for Nonconvex Distributed Constrained Optimization over Multi-Agent Systems

Distributed Optimization for Continuous Time Multiple Agents Systems with Unknown Parameters

An Expanded Distributed Algorithm for Dynamic Resource Allocation over Strongly Connected Topologies

Distributed algorithms for solving the convex feasibility problems