Abstract:Distributed optimization utilizes local computation and communication to realize a global aim of optimizing the sum of local objective functions. This article addresses a class of constrained distributed nonconvex optimization problems involving univariate objectives, aiming to achieve global optimization without requiring local evaluations of gradients at every iteration. We propose a novel algorithm named CPCA, exploiting the notion of combining Chebyshev polynomial approximation, average consensus, and polynomial optimization. The proposed algorithm is i) able to obtain $\epsilon$-globally optimal solutions for any arbitrarily small given accuracy $\epsilon$, ii) efficient in both zeroth-order queries (i.e., evaluations of function values) and inter-agent communication, and iii) distributed terminable when the specified precision requirement is met. The key insight is to use polynomial approximations to substitute for general local objectives, distribute these approximations via average consensus, and solve an easier approximate version of the original problem. Due to the nice analytic properties of polynomials, this approximation not only facilitates efficient global optimization, but also allows the design of gradient-free iterations to reduce cumulative costs of queries and achieve geometric convergence for solving nonconvex problems. We provide a comprehensive analysis of the accuracy and complexities of the proposed algorithm.

Linearly Convergent Second-Order Distributed Optimization Algorithms

An Initialization-Free Continuous-Time Distributed Algorithm for Convex Optimization Problem

Distributed Algorithms for Composite Optimization: Unified Framework and Convergence Analysis

Distributed Optimization Algorithm with Superlinear Convergence Rate

Distributed Stochastic Algorithm for Global Optimization in Networked System

A Unified Contraction Analysis of a Class of Distributed Algorithms for Composite Optimization

Distributed Zeroth-Order Optimization: Convergence Rates That Match Centralized Counterpart

A Unified Algorithmic Framework for Distributed Composite Optimization.

Distributed proximal‐gradient algorithms for nonsmooth convex optimization of second‐order multiagent systems

Distributed Robust Optimization in Networked System.

Distributed Adaptive Convex Optimization on Directed Graphs Via Continuous-Time Algorithms

Linear Convergence of First- and Zeroth-Order Primal-Dual Algorithms for Distributed Nonconvex Optimization

Sublinear and Linear Convergence of Modified ADMM for Distributed Nonconvex Optimization

Distributed Nonconvex Optimization: Gradient-free Iterations and $ε$-Globally Optimal Solution

Distributed Optimization for Second-Order Discrete-Time Multiagent Systems with Set Constraints.

Accelerated Primal-Dual Algorithms for Distributed Smooth Convex Optimization over Networks

Distributed Adaptive Newton Methods with Globally Superlinear Convergence

Convergence in High Probability of Distributed Stochastic Gradient Descent Algorithms

Achieving Globally Superlinear Convergence for Distributed Optimization with Adaptive Newton Method

Exponentially Convergent Algorithm Design for Constrained Distributed Optimization via Non-smooth Approach

Distributed adaptive Newton methods with global superlinear convergence