Abstract:Zeroth-order optimization has become increasingly important in complex optimization and machine learning when cost functions are impossible to be described in closed analytical forms. The key idea of zeroth-order optimization lies in the ability for a learner to build gradient estimates by queries sent to the cost function, and then traditional gradient descent algorithms can be executed replacing gradients by the estimates. For optimization over large-scale multi-agent systems with decentralized data and costs, zeroth-order optimization can continue to be utilized to develop scalable and distributed algorithms. In this paper, we aim at understanding the trend in performance transitioning from centralized to distributed zeroth-order algorithms in terms of convergence rates, and focus on multi-agent systems with time-varying communication networks. We establish a series of convergence rates for distributed zeroth-order subgradient algorithms under both one-point and two-point zeroth-order oracles. Apart from the additional node-to-node communication cost due to the distributed nature of algorithms, the established rates in convergence are shown to match their centralized counterpart. We also propose a multi-stage distributed zeroth-order algorithm that better utilizes the learning rates, reduces the computational complexity, and attains even faster convergence rates for compact decision set.

Distributed Optimization in Multi-agent Networks Using One-bit of Relative State Information

Distributed Discrete-Time Optimization in Multiagent Networks Using Only Sign of Relative State

Distributed Discrete-time Optimization in Multi-agent Networks Using only Sign of Relative State

Distributed Optimization For Resource Allocation With Event-Triggered Communication Under Directed Topology

A Distributed Algorithm for Resource Allocation Over Dynamic Digraphs.

Distributed Discrete-Time Optimization by Exchanging One Bit of Information

Distributed Stochastic Algorithm for Global Optimization in Networked System

Distributed Multi-Step Subgradient Optimization for Multi-Agent System

A Push-Pull Gradient Method for Distributed Optimization in Networks.

A game theoretical formulation for distributed optimization problems

Distributed initialization-free algorithms for multi-agent optimization problems with coupled inequality constraints

Augmented Distributed Gradient Methods for Multi-Agent Optimization under Uncoordinated Constant Stepsizes

An Expanded Distributed Algorithm for Dynamic Resource Allocation over Strongly Connected Topologies

Distributed Heterogeneous Multi-Agent Optimization with Stochastic Sub-Gradient

Distributed Zeroth-Order Optimization: Convergence Rates That Match Centralized Counterpart

Distributed Algorithms for Composite Optimization: Unified Framework and Convergence Analysis

Distributed Online Optimization for Multi-Agent Networks With Coupled Inequality Constraints

A New Game Model for Distributed Optimization Problems with Directed Communication Topologies

Distributed optimization algorithm for multi‐agent networks with lazy gradient information

Distributed Stochastic Optimization With Unbounded Subgradients Over Randomly Time-Varying Networks

Distributed optimization via multi-agent systems