Abstract:This paper explores a class of distributed constrained convex optimization problems where the objective function is a sum of $N$ convex local objective functions. These functions are characterized by local non-smoothness yet adhere to Lipschitz continuity, and the optimization process is further constrained by $N$ distinct closed convex sets. To delineate the structure of information exchange among agents, a series of time-varying weight-unbalance directed graphs are introduced. Furthermore, this study introduces a novel algorithm, distributed randomized gradient-free constrained optimization algorithm. This algorithm marks a significant advancement by substituting the conventional requirement for precise gradient or subgradient information in each iterative update with a random gradient-free oracle, thereby addressing scenarios where accurate gradient information is hard to obtain. A thorough convergence analysis is provided based on the smoothing parameters inherent in the local objective functions, the Lipschitz constants, and a series of standard assumptions. Significantly, the proposed algorithm can converge to an approximate optimal solution within a predetermined error threshold for the consisdered optimization problem, achieving the same convergence rate of ${\mathcal {O}}(\frac{\ln (k)}{\sqrt{k} })$ as the general randomized gradient-free algorithms when the decay step size is selected appropriately. And when at least one of the local objective functions exhibits strong convexity, the proposed algorithm can achieve a faster convergence rate, ${\mathcal {O}}(\frac{1}{k})$ . Finally, rigorous simulation results verify the correctness of theoretical findings.

Distributed Graph Estimation under Laplacian Constraints

Distributed Finite-Time Estimation of the Bounds on Algebraic Connectivity for Directed Graphs

Distributed Estimation of Algebraic Connectivity of Directed Networks.

Distributed estimation over complex networks

Distributed Constrained Nonlinear Least-Squares Estimation Algorithm Over Unbalanced Directed Networks

Distributed Sparse Recursive Least-Squares over Networks

Efficient Graph Laplacian Estimation by Proximal Newton

Cooperative Control Based on Distributed Estimation of Network Connectivity

Distributed Censored Regression over Networks

Distributed Parameter Estimation with Random Observation Matrices and Communication Graphs

Graph Learning from Data under Structural and Laplacian Constraints

Scalable Algorithms for Laplacian Pseudo-inverse Computation

Linear Convergence of Distributed Estimation with Constraints and Communication Delays

Distributed Estimation for Principal Component Analysis: An Enlarged Eigenspace Analysis

Discrete-Time Algorithms for Distributed Constrained Convex Optimization with Linear Convergence Rates

Efficient Distributed Transfer Learning for Large‐Scale Gaussian Graphic Models

Constrained Distributed Nonconvex Optimization over Time-varying Directed Graphs

Distributed Bayesian Estimation of Linear Models With Unknown Observation Covariances.

DC Algorithm for Estimation of Sparse Gaussian Graphical Models

Distributed Estimation with Empirical Likelihood

Distributed Randomized Gradient-free Convex Optimization with Set Constraints over Time-varying Weight-unbalanced Digraphs