Abstract:In this paper, the recurrent neural networks (RNNs) with a generalized activation function class is proposed. In this proposed model, every component of the neuron's activation function belongs to a convex hull which is bounded by two odd symmetric piecewise linear functions that are convex or concave over the real space. All of the convex hulls are composed of generalized activation function classes. The novel activation function class is not only with a more flexible and more specific description of the activation functions than other function classes but it also generalizes some traditional activation function classes. The absolute exponential stability (AEST) of the RNN with a generalized activation function class is studied through three steps. The first step is to demonstrate the global exponential stability (GES) of the equilibrium point of original RNN with a generalized activation function being equivalent to that of RNN under all vertex functions of convex hull. The second step transforms the RNN under every vertex activation function into neural networks under an array of saturated linear activation functions. Because the GES of the equilibrium point of three systems are equivalent, the next stability analysis focuses on the GES of the equilibrium point of RNN system under an array of saturated linear activation functions. The last step is to study both the existence of equilibrium point and the GES of the RNN under saturated linear activation functions using the theory of M-matrix. In the end, a two-neuron RNN with a generalized activation function is constructed to show the effectiveness of our results.

Multistability of Neural Networks with a Class of Activation Functions

Coexistence and Local Stability of Multiple Equilibria in Neural Networks with Piecewise Linear Nondecreasing Activation Functions

Multistability of Neural Networks with Mexican-Hat-Type Activation Functions.

Multiperiodicity of Periodically Oscillated Discrete-Time Neural Networks with Transient Excitatory Self-Connections and Sigmoidal Nonlinearities

The multistability of delayed competitive neural networks with piecewise non‐monotonic activation functions

Multistability and complete convergence analysis on high-order neural networks with a class of nonsmooth activation functions

Multistability analysis of delayed recurrent neural networks with a class of piecewise nonlinear activation functions

Nontrivial Global Attractors in 2-D Multistable Attractor Neural Networks

Multistability analysis of complex-valued recurrent neural networks with sine and cosine activation functions

Multiple μ-stability of neural networks with unbounded time-varying delays.

Multistability and new attraction basins of almost-periodic solutions of delayed neural networks.

Multistability in a class of stochastic delayed Hopfield neural networks

Multistability of Hopfield neural networks with a designed discontinuous sawtooth-type activation function

Multiple and Complete Stability of Recurrent Neural Networks With Sinusoidal Activation Function

Qualitative Analysis for Recurrent Neural Networks with Linear Threshold Transfer Functions

Multistability of Fuzzy Neural Networks With Rectified Linear Units and State-Dependent Switching Rules

A Step Towards Uncovering The Structure of Multistable Neural Networks

Stability and Bifurcation Analysis in a Class of Two-Neuron Networks with Resonant Bilinear Terms

Multistability analysis of state-dependent switched Hopfield neural networks with the Gaussian-wavelet-type activation function

Mixed-coexistence of periodic orbits and chaotic attractors in an inertial neural system with a nonmonotonic activation function.

Absolute Exponential Stability of Recurrent Neural Networks With Generalized Activation Function