Abstract:We consider a discrete-time model of continuous-time distributed optimization over dynamic directed-graphs (digraphs) with applications to distributed learning. Our optimization algorithm works over general strongly connected dynamic networks under switching topologies, e.g., in mobile multi-agent systems and volatile networks due to link failures. Compared to many existing lines of work, there is no need for bi-stochastic weight designs on the links. The existing literature mostly needs the link weights to be stochastic using specific weight-design algorithms needed both at the initialization and at all times when the topology of the network changes. This paper eliminates the need for such algorithms and paves the way for distributed optimization over time-varying digraphs. We derive the bound on the gradient-tracking step-size and discrete time-step for convergence and prove dynamic stability using arguments from consensus algorithms, matrix perturbation theory, and Lyapunov theory. This work, particularly, is an improvement over existing stochastic-weight undirected networks in case of link removal or packet drops. This is because the existing literature may need to rerun time-consuming and computationally complex algorithms for stochastic design, while the proposed strategy works as long as the underlying network is weight-symmetric and balanced. The proposed optimization framework finds applications to distributed classification and learning.

Distributed Discrete-Time Optimization by Exchanging One Bit of Information

Distributed Discrete-Time Optimization in Multiagent Networks Using Only Sign of Relative State

Distributed Optimization in Multi-agent Networks Using One-bit of Relative State Information

Distributed Discrete-time Optimization in Multi-agent Networks Using only Sign of Relative State

A Distributed Algorithm for Resource Allocation Over Dynamic Digraphs.

Distributed Optimization with Binary Relative Information over Deterministically Time-varying Graphs

Discretized Distributed Optimization over Dynamic Digraphs

Distributed Zeroth-Order Optimization: Convergence Rates That Match Centralized Counterpart

Distributed Optimization with Finite Bit Adaptive Quantization for Efficient Communication and Precision Enhancement

Distributed Stochastic Optimization With Unbounded Subgradients Over Randomly Time-Varying Networks

Distributed Continuous-Time Optimization with Uncertain Time-Varying Quadratic Cost Functions

Privacy-Preserving Distributed Online Optimization Over Unbalanced Digraphs via Subgradient Rescaling

Distributed Optimization with Quantized Gradient Descent

Distributed quasi-monotone subgradient algorithm for nonsmooth convex optimization over directed graphs

Distributed Stochastic Algorithm for Global Optimization in Networked System

Distributed Adaptive Time-Varying Optimization with Global Asymptotic Convergence

Quantized Distributed Nonconvex Optimization Algorithms with Linear Convergence under the Polyak--$Ł$ojasiewicz Condition

Decentralized Optimization On Time-Varying Directed Graphs Under Communication Constraints

Distributed Fixed-Time Optimization With Time-Varying Cost: Zero-Gradient-Sum Scheme

Distributed Optimization With Personalization: A Flexible Algorithmic Framework

Distributed Constrained Optimization With Delayed Subgradient Information Over Time-Varying Network Under Adaptive Quantization