Abstract:In this paper, the recurrent neural networks (RNNs) with a generalized activation function class is proposed. In this proposed model, every component of the neuron's activation function belongs to a convex hull which is bounded by two odd symmetric piecewise linear functions that are convex or concave over the real space. All of the convex hulls are composed of generalized activation function classes. The novel activation function class is not only with a more flexible and more specific description of the activation functions than other function classes but it also generalizes some traditional activation function classes. The absolute exponential stability (AEST) of the RNN with a generalized activation function class is studied through three steps. The first step is to demonstrate the global exponential stability (GES) of the equilibrium point of original RNN with a generalized activation function being equivalent to that of RNN under all vertex functions of convex hull. The second step transforms the RNN under every vertex activation function into neural networks under an array of saturated linear activation functions. Because the GES of the equilibrium point of three systems are equivalent, the next stability analysis focuses on the GES of the equilibrium point of RNN system under an array of saturated linear activation functions. The last step is to study both the existence of equilibrium point and the GES of the RNN under saturated linear activation functions using the theory of M-matrix. In the end, a two-neuron RNN with a generalized activation function is constructed to show the effectiveness of our results.

μ-stability and instability of multiple equilibrium points in delayed neural networks with general discontinuous activation functions

Multiperiodicity of Periodically Oscillated Discrete-Time Neural Networks with Transient Excitatory Self-Connections and Sigmoidal Nonlinearities

Multistability of Cohen–Grossberg neural networks based on activation functions with multiple discontinuous points

Multistability analysis of delayed recurrent neural networks with a class of piecewise nonlinear activation functions

Multiple μ-stability of neural networks with unbounded time-varying delays.

Periodic dynamics of multidirectional associative neural networks with discontinuous activation functions and mixed time delays

Multiple Mittag-Leffler Stability of Almost Periodic Solutions for Fractional-Order Delayed Neural Networks: Distributed Optimization Approach

Associative memories based on delayed fractional-order neural networks and application to explaining-lesson skills assessment of normal students: from the perspective of multiple $ \mathit O(t^{-\alpha}) $ stability

Dynamics Analysis and Analog Associative Memory of Networks with LT Neurons.

A New Lmi-Based Approach For Stability Analysis Of Cellular Neural Networks With Time Delay

The multistability of delayed competitive neural networks with piecewise non‐monotonic activation functions

Coexistence and Local Stability of Multiple Equilibria in Neural Networks with Piecewise Linear Nondecreasing Activation Functions

Finite‐time/fixed‐time stability and stabilization of a class of delayed neural networks system with discontinuous activation

Multistability of State-Dependent Switched Fractional-Order Hopfield Neural Networks With Mexican-Hat Activation Function and Its Application in Associative Memories

Multistability of Hopfield neural networks with a designed discontinuous sawtooth-type activation function

Absolute Exponential Stability of Recurrent Neural Networks With Generalized Activation Function

Delay-independent and delay-dependent stability of a novel delayed neural network

Dynamical Behaviors of Delayed Neural Network Systems with Discontinuous Activation Functions

Asymptotical Stability in Discrete-Time Neural Networks

Coexistence and local stability of multiple equilibrium points for fractional-order state-dependent switched competitive neural networks with time-varying delays

Multistability of Neural Networks with a Class of Activation Functions