Abstract:Consider that the constrained convex optimization problems have emerged in a variety of scientific and engineering applications that often require efficient and fast solutions. Inspired by the Nesterov’s accelerated method for solving unconstrained convex and strongly convex optimization problems, in this paper we propose two novel accelerated projection neurodynamic approaches for constrained smooth convex and strongly convex optimization based on the variational approach. First, for smooth, and convex optimization problems, a non-autonomous accelerated projection neurodynamic approach (NAAPNA) is presented and the existence, uniqueness and feasibility of the solution to it are analyzed rigorously. We provide that the NAAPNA has a convergence rate which is inversely proportional to the square of the running time. In addition, we present a novel autonomous accelerated projection neurodynamic approach (AAPNA) for addressing the constrained, smooth, strongly convex optimization problems and prove the existence, uniqueness to the strong global solution of AAPNA based on the Cauchy–Lipschitz–Picard theorem. Furthermore, we also prove the global convergence of AAPNA with different exponential convergence rates for different parameters. Compared with existing projection neurodynamic approaches based on the Brouwer’s fixed point theorem, both NAAPNA and AAPNA use the projection operators of the auxiliary variable to map the primal variables to the constrained feasible region, thus our proposed neurodynamic approaches are easier to realize algorithm’s acceleration. Finally, the effectiveness of NAAPNA and AAPNA is illustrated with several numerical examples.

A Survey on Projection Neural Networks and Their Applications

Convergence of Projected Subgradient Method with Sparse or Low-Rank Constraints

Novel Projection Neurodynamic Approaches for Constrained Convex Optimization

A New Projection Neural Network for Linear and Convex Quadratic Second-Order Cone Programming

A Projection Neural Network for Constrained Quadratic Minimax Optimization

A modified projection neural network for linear variational inequalities and quadratic optimization problems

A New Result for Projection Neural Networks to Solve Linear Variational Inequalities and Related Optimization Problems.

Solving Pseudomonotone Variational Inequalities and Pseudoconvex Optimization Problems Using the Projection Neural Network.

On Convergence Rate of Projection Neural Networks

A Survey of Neurodynamic Optimization

Distributed Smoothing Projection Neurodynamic Approaches for Constrained Nonsmooth Optimization

Delayed Projection Techniques for Linearly Constrained Problems: Convergence Rates, Acceleration, and Applications

A Modified Projection Neural Network with Fixed-Time Convergence

A Projection Neural Network to Nonsmooth Constrained Pseudoconvex Optimization

Projected Neural Network for a Class of Non-Lipschitz Optimization Problems with Linear Constraints.

Recurrent neural network model based on projective operator and its application to optimization problems

One-Layer Continuous-and Discrete-Time Projection Neural Networks for Solving Variational Inequalities and Related Optimization Problems

An Improved Inertial Projection Method for Solving Convex Constrained Monotone Nonlinear Equations with Applications

Design of General Projection Neural Networks for Solving Monotone Linear Variational Inequalities and Linear and Quadratic Optimization Problems

Differentiable Projection for Constrained Deep Learning

Distributed Stochastic Projection-Free Algorithm for Constrained Optimization