Abstract:We consider a discrete-time model of continuous-time distributed optimization over dynamic directed-graphs (digraphs) with applications to distributed learning. Our optimization algorithm works over general strongly connected dynamic networks under switching topologies, e.g., in mobile multi-agent systems and volatile networks due to link failures. Compared to many existing lines of work, there is no need for bi-stochastic weight designs on the links. The existing literature mostly needs the link weights to be stochastic using specific weight-design algorithms needed both at the initialization and at all times when the topology of the network changes. This paper eliminates the need for such algorithms and paves the way for distributed optimization over time-varying digraphs. We derive the bound on the gradient-tracking step-size and discrete time-step for convergence and prove dynamic stability using arguments from consensus algorithms, matrix perturbation theory, and Lyapunov theory. This work, particularly, is an improvement over existing stochastic-weight undirected networks in case of link removal or packet drops. This is because the existing literature may need to rerun time-consuming and computationally complex algorithms for stochastic design, while the proposed strategy works as long as the underlying network is weight-symmetric and balanced. The proposed optimization framework finds applications to distributed classification and learning.

Distributed quasi-monotone subgradient algorithm for nonsmooth convex optimization over directed graphs

An Initialization-Free Continuous-Time Distributed Algorithm for Convex Optimization Problem

Accelerated Primal-Dual Algorithms for Distributed Smooth Convex Optimization over Networks

Distributed Stochastic Algorithm for Global Optimization in Networked System

A Push-Pull Gradient Method for Distributed Optimization in Networks.

Distributed Adaptive Convex Optimization on Directed Graphs Via Continuous-Time Algorithms

Distributed Algorithms for Composite Optimization: Unified Framework and Convergence Analysis

Non-Smooth Setting of Stochastic Decentralized Convex Optimization Problem Over Time-Varying Graphs

Distributed Multi-Step Subgradient Optimization for Multi-Agent System

A Unified Contraction Analysis of a Class of Distributed Algorithms for Composite Optimization

A Unified Algorithmic Framework for Distributed Composite Optimization.

Convergence in High Probability of Distributed Stochastic Gradient Descent Algorithms

Distributed Stochastic Optimization With Unbounded Subgradients Over Randomly Time-Varying Networks

Distributed Heterogeneous Multi-Agent Optimization with Stochastic Sub-Gradient

Distributed Nonsmooth Convex Optimization over Markovian Switching Random Networks with Two Step-Sizes

Distributed proximal‐gradient algorithms for nonsmooth convex optimization of second‐order multiagent systems

Discretized Distributed Optimization over Dynamic Digraphs

Distributed Optimization with Quantized Gradient Descent

Distributed algorithms for solving convex inequalities.

Distributed Stochastic Consensus Optimization With Momentum for Nonconvex Nonsmooth Problems

Exponentially Convergent Algorithm Design for Constrained Distributed Optimization via Non-smooth Approach