Abstract:Variational inequality (VI) can be viewed as a natural framework for unifying the treatment of equilibrium problems, and hence has applications across many disciplines. In addition, many typical problems are closely related to VI, including general VI (GVI), complementarity problem (CP), generalized CP (GCP) and optimization problem (OP). During the past two decades, numerous recurrent neural networks (RNNs) have been proposed for solving VIs and related problems. However, first, the theories of many emerging RNNs have not been well founded yet; and their capabilities have been underestimated. Second, these RNNs have limitations in handling some types of problems. Third, it is certainly not true that these RNNs are best choices for solving all problems, and new network models with more favorable characteristics could be devised for solving specific problems. In the research, the above issues are extensively explored from dynamic system perspective, which leads to the following major contributions. On one hand, many new capabilities of some existing RNNs have been revealed for solving VIs and related problems. On the other hand, several new RNNs have been invented for solving some types of these problems. The contributions are established on the following facts. First, two existing RNNs, called TLPNN and PNN, are found to be capable of solving pseudomonotone VIs and related problems with simple bound constraints. Second, many more stability results are revealed for an existing RNN, called GPNN, for solving GVIs with simple bound constraints, and it is then extended to solve linear VIs (LVIs) and generalized linear VIs (GLVIs) with polyhedron constraints. Third, a new RNN, called IDNN, is proposed for solving a special class of quadratic programming problems which features lower structural complexity compared with existing RNNs. Fourth, some local convergence results of an existing RNN, called EPNN, for nonconvex optimization are obtained, and two variants of the network by incorporating two augmented Lagrangian function techniques are proposed for seeking Karush-Kuhn-Tucker (KKT) points, especially local optima, of the problems.

A fast algorithm for solving large scale nonlinear optimization problems using RNN

A discrete-time neural network for optimization problems with hybrid constraints.

Solving variational inequalities and related problems using recurrent neural networks

A Recurrent Neural Network for Solving Nonconvex Optimization Problems

On RNN Models for Solving Dynamic System of Linear Equations

Design, Verification, and Application of New Discrete-Time Recurrent Neural Network for Dynamic Nonlinear Equations Solving

Two Recurrent Neural Networks With Reduced Model Complexity for Constrained l1-Norm Optimization

Analysis and Application of Matrix-Form Neural Networks for Fast Matrix-Variable Convex Optimization

Robust Exponential Stability Analysis of a Larger Class of Discrete-Time Recurrent Neural Networks

A recurrent neural network for non-smooth convex programming subject to linear equality and bound constraints

New Recurrent Neural Network for Online Solution of Time-Dependent Underdetermined Linear System with Bound Constraint

A New Recurrent Neural Network with Noise-Tolerance and Finite-Time Convergence for Dynamic Quadratic Minimization.

A High-Performance Feedback Neural Network for Solving Convex Nonlinear Programming Problems

A Neural Network for Solving Nonlinear Convex Programming with Linear Equality and Bounded Constraints

RNN for Solving Perturbed Time-Varying Underdetermined Linear System with Double Bound Limits on Residual Errors and State Variables.

A Neural Network for Solving Nonlinear Programming Problems.

Solving Time-Varying System of Nonlinear Equations by Finite-Time Recurrent Neural Networks with Application to Motion Tracking of Robot Manipulators

Recurrent neural network model based on projective operator and its application to optimization problems

Design and Analysis of Recurrent Neural Network Models with Non‐linear Activation Functions for Solving Time‐varying Quadratic Programming Problems

Static Linear Algebra Problems Solving via Elegant Design Formula and Simplified Explicit Form of Zhang Neural Network with Illustrative Instances

A Two-Layer Recurrent Neural Network for Nonsmooth Convex Optimization Problems