Abstract:In this paper, we consider a stochastic distributed nonconvex optimization problem with the cost function being distributed over n agents having access only to zeroth-order (ZO) information of the cost. This problem has various machine learning applications. As a solution, we propose two distributed ZO algorithms, in which at each iteration each agent samples the local stochastic ZO oracle at two points with a time-varying smoothing parameter. We show that the proposed algorithms achieve the linear speedup convergence rate O(p/(nT)) for smooth cost functions under the state-dependent variance assumptions which are more general than the commonly used bounded variance and Lipschitz assumptions, and O(p/(nT)) convergence rate when the global cost function additionally satisfies the Polyak–Łojasiewicz (P–Ł) condition, where p and T are the dimension of the decision variable and the total number of iterations, respectively. To the best of our knowledge, this is the first linear speedup result for distributed ZO algorithms. It consequently enables systematic processing performance improvements by adding more agents. We also show that the proposed algorithms converge linearly under the relatively bounded second moment assumptions and the P–Ł condition. We demonstrate through numerical experiments the efficiency of our algorithms on generating adversarial examples from deep neural networks in comparison with baseline and recently proposed centralized and distributed ZO algorithms.

Finite-time Distributed ConvexOptimization with Zero-Gradient-Sum Algorithms

Designing Zero-Gradient-Sum Protocols for Finite-Time Distributed Optimization Problem

An Initialization-Free Continuous-Time Distributed Algorithm for Convex Optimization Problem

Zero-Gradient-Sum Algorithms for Distributed Convex Optimization: The Continuous-Time Case

Distributed Zeroth-Order Optimization: Convergence Rates That Match Centralized Counterpart

Distributed Fixed-Time Optimization With Time-Varying Cost: Zero-Gradient-Sum Scheme

Distributed Stochastic Algorithm for Global Optimization in Networked System

Distributed Algorithms for Composite Optimization: Unified Framework and Convergence Analysis

Zeroth-Order Non-Convex Optimization for Cooperative Multi-Agent Systems with Diminishing Step Size and Smoothing Radius

Extended Zero-Gradient-Sum Approach for Constrained Distributed Optimization with Free Initialization

Zeroth-order algorithms for stochastic distributed nonconvex optimization

A Unified Contraction Analysis of a Class of Distributed Algorithms for Composite Optimization

Accelerated Primal-Dual Algorithms for Distributed Smooth Convex Optimization over Networks

Robust fixed-time distributed optimization with predefined convergence-time bound

Single Point-Based Distributed Zeroth-Order Optimization with a Non-Convex Stochastic Objective Function

A Unified Algorithmic Framework for Distributed Composite Optimization.

Linear Convergence of First- and Zeroth-Order Primal-Dual Algorithms for Distributed Nonconvex Optimization

Distributed Optimization Algorithm with Superlinear Convergence Rate

Convergence in High Probability of Distributed Stochastic Gradient Descent Algorithms

Distributed Adaptive Time-Varying Optimization with Global Asymptotic Convergence

Zeroth-Order Feedback Optimization in Multi-Agent Systems: Tackling Coupled Constraints