Abstract:Generalized gradient projection neural network models are proposed to solve nonsmooth convex and nonconvex nonlinear programming problems over a closed convex subset of ℝ n . By using Clarke’s generalized gradient, the neural network modeled by a differential inclusion is developed, and its dynamical behavior and optimization capabilities both for convex and nonconvex problems are rigorously analyzed in the framework of nonsmooth analysis and the differential inclusion theory. First for nonconvex optimization problems, the quasiconvergence results similar to those achieved by previous work are proved. For convex optimization problems, the global convergence results are proved, i.e. any trajectory of the neural network converges to an asymptotically stable equilibrium point, which is an optimal solution of the primal problem whenever it exists. This result remains valid even if the initial condition is chosen outside the feasible set. In addition, an asymptotic control result involving a Tykhonov-like regularization shows that any trajectory of the revised neural network can be forced to converge toward a particular optimal solution of the primal problem. Finally, two simulation optimization algorithms for solving the optimization and control problems are designed respectively, and three typical simulation experiments are illustrated to present the accuracy and efficiency of theoretical convergence results of this paper.

Solving A Class Of Saddle Point Problems By Neural Networks

A Neural Network For Smooth Nonconvex Saddle Point Problems

A Topological Approach to the Existence of Solutions for Nonlinear Differential Equations with Piecewise Constant Argument

Differential inclusions-based neural networks for nonsmooth convex optimization on a closed convex subset

Dynamic System for Solving Saddle Point Problems in Hilbert Spaces and Its Application to Neural Computing

Neural Network for Solving Constrained Convex Optimization Problems with Global Attractivity

Subgradient-based Neural Networks for Nonsmooth Nonconvex Optimization Problems

Evolution Differential Inclusion with Projection for Solving Constrained Nonsmooth Convex Optimization in Hilbert Space

Smoothing Neural Network for L 0 Regularized Optimization Problem with General Convex Constraints

The Neural Network Approach to Inverse Problems in Differential Equations

Smoothing Neural Network for Constrained Non-Lipschitz Optimization with Applications

A neural network for constrained saddle point problems: an approximation approach

A Neural Network for Solving Inverse Quasi-Variational Inequalities

Method for finding solution to nonsmooth differential inclusion of special structure

A Dynamical Approach to Constrained Nonsmooth Convex Minimization Problem Coupling with Penalty Function Method in Hilbert Space

On Solutions to Several Classes of Differential-Algebraic Equations Based on Artificial Neural Networks

Differentiating Nonsmooth Solutions to Parametric Monotone Inclusion Problems

Solving High-Dimensional Partial Differential Equations Using Tensor Neural Network and A Posteriori Error Estimators

Neural Network As a Function Approximator and Its Application in Solving Differential Equations

Generalized Gradient Projection Neural Networks for Nonsmooth Optimization Problems

A method for finding a solution to the nonsmooth differential inclusion of a special structure