Abstract:In this paper, the recurrent neural networks (RNNs) with a generalized activation function class is proposed. In this proposed model, every component of the neuron's activation function belongs to a convex hull which is bounded by two odd symmetric piecewise linear functions that are convex or concave over the real space. All of the convex hulls are composed of generalized activation function classes. The novel activation function class is not only with a more flexible and more specific description of the activation functions than other function classes but it also generalizes some traditional activation function classes. The absolute exponential stability (AEST) of the RNN with a generalized activation function class is studied through three steps. The first step is to demonstrate the global exponential stability (GES) of the equilibrium point of original RNN with a generalized activation function being equivalent to that of RNN under all vertex functions of convex hull. The second step transforms the RNN under every vertex activation function into neural networks under an array of saturated linear activation functions. Because the GES of the equilibrium point of three systems are equivalent, the next stability analysis focuses on the GES of the equilibrium point of RNN system under an array of saturated linear activation functions. The last step is to study both the existence of equilibrium point and the GES of the RNN under saturated linear activation functions using the theory of M-matrix. In the end, a two-neuron RNN with a generalized activation function is constructed to show the effectiveness of our results.

Globally Exponentially Stability of Discrete-Time Recurrent Neural Networks with Unsaturating Linear Activation Functions

Global Exponential Stability of Discrete-Time Neural Networks for Constrained Quadratic Optimization

Sufficient and Necessary Conditions for Global Exponential Stability of Discrete-Time Recurrent Neural Networks

Global Exponential Stability In Lagrange Sense Of Continuous-Time Recurrent Neural Networks

Some characterizations of global exponential stability of a generic class of continuous-time recurrent neural networks.

Global Exponential Stability of A General Class of Recurrent Neural Networks with Variable Delays

Global exponential stability in Lagrange sense for recurrent neural networks with time delays

Global Exponential Stability of Recurrent Neural Networks with Time-Varying Delay

Global convergence rate of recurrently connected neural networks.

Global exponential stability for recurrent neural networks with a general class of activation functions and variable delays

Multistability of discrete-time recurrent neural networks with unsaturating piecewise linear activation functions.

Global Exponential Stability of Recurrent Neural Networks with Time-Dependent Switching Dynamics

Global Exponential Stability of a Class of Neural Circuits

A Generalized LMI-Based Approach to the Global Exponential Stability of Recurrent Neural Networks with Delay

Absolute Exponential Stability of Recurrent Neural Networks With Generalized Activation Function

Global Exponential Stability in Lagrange Sense for Neutral Type Recurrent Neural Networks

Global Asymptotic Stability of Delayed Neural Networks with Discontinuous Neuron Activations.

Globally exponential stability for neural networks with time-varying delays

Absolute Exponential Stability of Recurrent Neural Networks with Lipschitz-continuous Activation Functions and Time Delays.

Global Exponential Stability in Lagrange Sense for Periodic Neural Networks with Various Activation Functions

New condition for global exponential stability of neural networks