Abstract:Generalized gradient projection neural network models are proposed to solve nonsmooth convex and nonconvex nonlinear programming problems over a closed convex subset of ℝ n . By using Clarke’s generalized gradient, the neural network modeled by a differential inclusion is developed, and its dynamical behavior and optimization capabilities both for convex and nonconvex problems are rigorously analyzed in the framework of nonsmooth analysis and the differential inclusion theory. First for nonconvex optimization problems, the quasiconvergence results similar to those achieved by previous work are proved. For convex optimization problems, the global convergence results are proved, i.e. any trajectory of the neural network converges to an asymptotically stable equilibrium point, which is an optimal solution of the primal problem whenever it exists. This result remains valid even if the initial condition is chosen outside the feasible set. In addition, an asymptotic control result involving a Tykhonov-like regularization shows that any trajectory of the revised neural network can be forced to converge toward a particular optimal solution of the primal problem. Finally, two simulation optimization algorithms for solving the optimization and control problems are designed respectively, and three typical simulation experiments are illustrated to present the accuracy and efficiency of theoretical convergence results of this paper.

Differential inclusions-based neural networks for nonsmooth convex optimization on a closed convex subset

A neural network model for non-smooth optimization over a compact convex subset

Generalized Gradient Projection Neural Networks for Nonsmooth Optimization Problems

A discrete-time neural network for optimization problems with hybrid constraints.

Subgradient-based Feedback Neural Networks for Non-Differentiable Convex Optimization Problems

A subgradient-based neurodynamic algorithm to constrained nonsmooth nonconvex interval-valued optimization

A nonautonomous-differential-inclusion neurodynamic approach for nonsmooth distributed optimization on multi-agent systems

Convergence analysis of the Gauss–Newton method for convex inclusion and convex-composite optimization problems

A New Neural Network Model And Its Application

Standard neural network model and its application

A fast algorithm for solving large scale nonlinear optimization problems using RNN

Enhancing neurodynamic approach with physics-informed neural networks for solving non-smooth convex optimization problems

A Neural Network Based on a Nonsmooth Equation for a Box Constrained Variational Inequality Problem

Convergence Analysis of a Class of Nonsmooth Gradient Systems.

A Novel Neural Network for Nonlinear Convex Programming

A varying-parameter fixed-time gradient-based dynamic network for convex optimization

Method for finding solution to nonsmooth differential inclusion of special structure

A Dynamical View on Optimization Algorithms of Overparameterized Neural Networks

Inexact Proximal Cubic Regularized Newton Methods for Convex Optimization

New Generalized Derivatives for Solving Variational Inequalities Using the Nonsmooth Newton Methods

A Neural Network for Solving Inverse Quasi-Variational Inequalities