Abstract:Zeroth-order optimization has become increasingly important in complex optimization and machine learning when cost functions are impossible to be described in closed analytical forms. The key idea of zeroth-order optimization lies in the ability for a learner to build gradient estimates by queries sent to the cost function, and then traditional gradient descent algorithms can be executed replacing gradients by the estimates. For optimization over large-scale multi-agent systems with decentralized data and costs, zeroth-order optimization can continue to be utilized to develop scalable and distributed algorithms. In this paper, we aim at understanding the trend in performance transitioning from centralized to distributed zeroth-order algorithms in terms of convergence rates, and focus on multi-agent systems with time-varying communication networks. We establish a series of convergence rates for distributed zeroth-order subgradient algorithms under both one-point and two-point zeroth-order oracles. Apart from the additional node-to-node communication cost due to the distributed nature of algorithms, the established rates in convergence are shown to match their centralized counterpart. We also propose a multi-stage distributed zeroth-order algorithm that better utilizes the learning rates, reduces the computational complexity, and attains even faster convergence rates for compact decision set.

Corrigendum to "Balance of Communication and Convergence: Predefined-time Distributed Optimization Based on Zero-Gradient-Sum"

Designing Zero-Gradient-Sum Protocols for Finite-Time Distributed Optimization Problem

A distributed algorithm with less communication for resource allocation problem

Finite-time Distributed ConvexOptimization with Zero-Gradient-Sum Algorithms

Distributed Algorithms for Composite Optimization: Unified Framework and Convergence Analysis

Distributed Zeroth-Order Optimization: Convergence Rates That Match Centralized Counterpart

A Unified Contraction Analysis of a Class of Distributed Algorithms for Composite Optimization

Distributed Stochastic Algorithm for Global Optimization in Networked System

A Unified Algorithmic Framework for Distributed Composite Optimization.

Distributed Fixed-Time Optimization With Time-Varying Cost: Zero-Gradient-Sum Scheme

Accelerated Primal-Dual Algorithms for Distributed Smooth Convex Optimization over Networks

Zero-Gradient-Sum Algorithms for Distributed Convex Optimization: The Continuous-Time Case

Distributed Constrained Optimization with Linear Convergence Rate

Distributed Aggregative Optimization via Finite-time Dynamic Average Consensus

Robust fixed-time distributed optimization with predefined convergence-time bound

Convergence in High Probability of Distributed Stochastic Gradient Descent Algorithms

Extended Zero-Gradient-Sum Approach for Constrained Distributed Optimization with Free Initialization

A Fixed-time Distributed Optimization Algorithm Based on Event-triggered Strategy

Accelerating Distributed Optimization via Fixed-time Convergent Flows: Extensions to Non-convex Functions and Consistent Discretization

Distributed Stochastic Consensus Optimization With Momentum for Nonconvex Nonsmooth Problems

Distributed Optimization Algorithm with Superlinear Convergence Rate