Abstract:In this paper, the problem of distributed optimization with nonconvex objective functions is studied by employing a network of agents. Each agent only has access to a noisy estimate on the gradient of its own objective function, and can only communicate with its immediate neighbors via a time-varying directed graph. To handle this problem, a distributed stochastic gradient descent algorithm is adopted. Existing works on distributed algorithms involving stochastic gradients only provide convergence results in expectation. Different from them, we study the convergence of the algorithm in high probability, i.e., the asymptotic convergence rate of the algorithm is characterized by the natural logarithm of the failure probability's inverse. Under mild assumptions on the graph connectivity, we prove that for the general nonconvex objective function, the average of gradients' norm squared converges in high probability. Furthermore, we also consider the case where the objective function satisfies the Polyak-Łojasiewicz condition. In this case, the difference between the objective function and its minimum value converges in high probability, and the convergence rate is faster than that in the general nonconvex case. Finally, simulations are provided to demonstrate the effectiveness of our theoretical results.

A Gradient-Descent Neurodynamic Approach For Distributed Linear Programming

Distributed Neurodynamic Approaches to Nonsmooth Optimization Problems with Inequality and Set Constraints

A Penalty-Like Neurodynamic Approach to Constrained Nonsmooth Distributed Convex Optimization

A continuous-time neurodynamic algorithm for distributed nonconvex nonsmooth optimization problems with affine equality and nonsmooth convex inequality constraints

Linear Convergence of Distributed Aggregative Optimization with Coupled Inequality Constraints

A Subgradient-Based Neural Network to Constrained Distributed Convex Optimization

A Push-Pull Gradient Method for Distributed Optimization in Networks.

A Second-Order Accelerated Neurodynamic Approach for Distributed Convex Optimization

A neurodynamic approach to nonlinear optimization problems with affine equality and convex inequality constraints.

A Neurodynamic Approach to Distributed Optimization with Globally Coupled Constraints.

Linear Convergence for Distributed Optimization Without Strong Convexity.

Distributed nonconvex optimization subject to globally coupled constraints via collaborative neurodynamic optimization

Linear Convergence of Primal-Dual Gradient Methods and their Performance in Distributed Optimization

A subgradient-based neurodynamic algorithm to constrained nonsmooth nonconvex interval-valued optimization

A Fixed-Time Gradient Algorithm for Distributed Optimization with Inequality Constraints.

Distributed Optimization with Multiple Linear Equality Constraints and Convex Inequality Constraints

A Continuous-Time Neurodynamic Approach and Its Discretization for Distributed Convex Optimization over Multi-Agent Systems

A P-Power Neurodynamic Approach to Distributed Nonconvex Optimization

Linear Convergence for Distributed Stochastic Optimization with Coupled Inequality Constraints

A New Gradient-Based Neural Network for Solving Linear and Quadratic Programming Problems.

Convergence in High Probability of Distributed Stochastic Gradient Descent Algorithms