Abstract:Recurrent neural networks for solving constrained least absolute deviation (LAD) problems or L-1-norm optimization problems have attracted much interest in recent years. But so far most neural networks can only deal with some special linear constraints efficiently. In this paper, two neural networks are proposed for solving LAD problems with various linear constraints including equality, two-sided inequality and bound constraints. When tailored to solve some special cases of LAD problems in which not all types of constraints are present, the two networks can yield simpler architectures than most existing ones in the literature. In particular, for solving problems with both equality and one-sided inequality constraints, another network is invented. All of the networks proposed in this paper are rigorously shown to be capable of solving the corresponding problems. The different networks designed for solving the same types of problems possess the same structural complexity, which is due to the fact these architectures share the same computing blocks and only differ in connections between some blocks. By this means, some flexibility for circuits realization is provided. Numerical simulations are carried out to illustrate the theoretical results and compare the convergence rates of the networks.

A one-layer recurrent neural network for constrained single-ratio linear fractional programming

A One-Layer Dual Recurrent Neural Network with a Heaviside Step Activation Function for Linear Programming with Its Linear Assignment Application

A one-layer recurrent neural network for nonsmooth pseudoconvex optimization with quasiconvex inequality and affine equality constraints

A One-Layer Recurrent Neural Network for Pseudoconvex Optimization Problems with Equality and Inequality Constraints.

Neural Network Solution for General Nonlinear Optimization Problems

A One-Layer Recurrent Neural Network for Constrained Complex-Variable Convex Optimization.

A discrete-time neural network for optimization problems with hybrid constraints.

Recurrent Neural Network for Complex-Variable Pseudoconvex Optimization with Equality Constraints

A fast algorithm for solving large scale nonlinear optimization problems using RNN

Another simple recurrent neural network for quadratic and linear programming

Design of Recurrent Neural Networks for Solving Constrained Least Absolute Deviation Problems.

A novel two-layer fuzzy neural network for solving inequality-constrained ℓ1-minimization problem with applications

A new one-layer recurrent neural network for nonsmooth pseudoconvex optimization.

A Neural Network for Solving Nonlinear Convex Programming with Linear Equality and Bounded Constraints

Two Recurrent Neural Networks With Reduced Model Complexity for Constrained l1-Norm Optimization

Two-Level Linear Relaxation Method for Generalized Linear Fractional Programming

Convergence analysis of discrete time recurrent neural networks for linear variational inequality problem

A Recurrent Neural Network with Finite-Time Convergence for Convex Quadratic Bilevel Programming Problems

A new linearization technique for minimax linear fractional programming

A Recurrent Neural Network Approach for Nonconvex Interval Quadratic Programming

An efficient branch and bound reduction algorithm for globally solving linear fractional programming problems