Abstract:Variational inequality (VI) can be viewed as a natural framework for unifying the treatment of equilibrium problems, and hence has applications across many disciplines. In addition, many typical problems are closely related to VI, including general VI (GVI), complementarity problem (CP), generalized CP (GCP) and optimization problem (OP). During the past two decades, numerous recurrent neural networks (RNNs) have been proposed for solving VIs and related problems. However, first, the theories of many emerging RNNs have not been well founded yet; and their capabilities have been underestimated. Second, these RNNs have limitations in handling some types of problems. Third, it is certainly not true that these RNNs are best choices for solving all problems, and new network models with more favorable characteristics could be devised for solving specific problems. In the research, the above issues are extensively explored from dynamic system perspective, which leads to the following major contributions. On one hand, many new capabilities of some existing RNNs have been revealed for solving VIs and related problems. On the other hand, several new RNNs have been invented for solving some types of these problems. The contributions are established on the following facts. First, two existing RNNs, called TLPNN and PNN, are found to be capable of solving pseudomonotone VIs and related problems with simple bound constraints. Second, many more stability results are revealed for an existing RNN, called GPNN, for solving GVIs with simple bound constraints, and it is then extended to solve linear VIs (LVIs) and generalized linear VIs (GLVIs) with polyhedron constraints. Third, a new RNN, called IDNN, is proposed for solving a special class of quadratic programming problems which features lower structural complexity compared with existing RNNs. Fourth, some local convergence results of an existing RNN, called EPNN, for nonconvex optimization are obtained, and two variants of the network by incorporating two augmented Lagrangian function techniques are proposed for seeking Karush-Kuhn-Tucker (KKT) points, especially local optima, of the problems.

Fixed-Time Neural Networks with Time-Invariant and Time-Varying Coefficients for Mixed Variational Inequalities

A discrete-time neural network for optimization problems with hybrid constraints.

Discrete-Time Projection Neural Network Methods for Computing the Solution of Variational Inequalities

Convergence analysis of discrete time recurrent neural networks for linear variational inequality problem

Predefined-time convergent neural networks for solving the time-varying nonsingular multi-linear tensor equations

Design of General Projection Neural Networks for Solving Monotone Linear Variational Inequalities and Linear and Quadratic Optimization Problems

A novel predefined-time neurodynamic approach for mixed variational inequality problems and applications

A Novel Method to Solve Inverse Variational Inequality Problems Based on Neural Networks

Fixed-/preassigned-time synchronization for delayed complex-valued neural networks with discontinuous activations

A Novel Recurrent Neural Network-Based Ultra-Fast, Robust, and Scalable Solver for Inverting a "Time-Varying Matrix"

A novel two-layer fuzzy neural network for solving inequality-constrained ℓ1-minimization problem with applications

Solving variational inequalities and related problems using recurrent neural networks

A varying-parameter fixed-time gradient-based dynamic network for convex optimization

A recurrent neural network for solving a class of general variational inequalities.

A Recurrent Neural Network With Explicitly Definable Convergence Time for Solving Time-Variant Linear Matrix Equations

A mixture varying-gain dynamic learning network for solving nonlinear and nonconvex constrained optimization problems

Time-varying neurodynamic optimization approaches with fixed-time convergence for sparse signal reconstruction

Stability analysis of time-varying delay neural networks based on new integral inequalities

Fixed-Time Neurodynamic Optimization Algorithms and Application to Circuits Design

A Fixed-Time Proximal Gradient Neurodynamic Network With Time-Varying Coefficients for Composite Optimization Problems and Sparse Optimization Problems With Log-Sum Function

Finite-time stabilization of memristor-based inertial neural networks with time-varying delays combined with interval matrix method