Abstract:In this article, we investigate a constrained composition optimization problem in a directed communication network. Each agent is equipped with a local objective function composed of both smooth and nonsmooth terms, as well as linear equality constraints. The optimization objective is to minimize the sum of all local functions, subject to linear equality constraints, through local computations and information exchange with neighboring agents. Based on the alternating direction method of multipliers (ADMM), a novel distributed optimization algorithm is proposed to address the composite optimization problem. We leverage the composite structure of the objective function, by introducing a linear approximation for the smooth term and a proximal mapping for the nonsmooth term, which simplifies the process of solving the ADMM subproblem. Furthermore, in contrast to the existing algorithms that eliminate the imbalance resulting from directed graphs using a column-stochastic matrix, the proposed algorithm only employs a row-stochastic matrix, thereby avoiding the need for agents to know their outdegree. Moreover, the step sizes of agents are uncoordinated and can be independent of the network topology. Furthermore, we prove that the proposed algorithm achieves a sublinear convergence rate when the local objective functions are convex. Finally, the effectiveness of the proposed algorithm is verified through numerical simulations.

Distributed Proximal Point Algorithm For Constrained Optimization Over Unbalanced Graphs

An Initialization-Free Continuous-Time Distributed Algorithm for Convex Optimization Problem

A Distributed Algorithm for Resource Allocation Over Dynamic Digraphs.

An Exponentially Convergent Distributed Algorithm for Resource Allocation Problem

On the convergence of the distributed proximal point algorithm

Regularized dual gradient distributed method for constrained convex optimization over unbalanced directed graphs

Distributed Algorithms for Composite Optimization: Unified Framework and Convergence Analysis

A Unified Contraction Analysis of a Class of Distributed Algorithms for Composite Optimization

Distributed Unbalanced Optimization Design over Nonidentical Constraints

Distributed Robust Optimization in Networked System.

Convergence in High Probability of Distributed Stochastic Gradient Descent Algorithms

A Push-Pull Gradient Method for Distributed Optimization in Networks.

Distributed Stochastic Algorithm for Global Optimization in Networked System

Accelerated Primal-Dual Algorithms for Distributed Smooth Convex Optimization over Networks

A Forward-Backward Bregman Splitting Scheme for Regularized Distributed Optimization Problems

Online Distributed Optimization With Nonconvex Objective Functions Under Unbalanced Digraphs: Dynamic Regret Analysis

A Decentralized Proximal Point-type Method for Non-convex Non-concave Saddle Point Problems

Distributed Adaptive Convex Optimization on Directed Graphs Via Continuous-Time Algorithms

Distributed Proximal Alternating Direction Method of Multipliers for Constrained Composite Optimization Over Directed Networks

Exponentially Convergent Algorithm Design for Constrained Distributed Optimization via Non-smooth Approach

Solving a class of nonsmooth resource allocation problems with directed graphs through distributed Lipschitz continuous multi-proximal algorithms