Abstract:The Elman neural network has good dynamic properties and strong global stability, being most widely used to deal with nonlinear, dynamic, and complex data. However, as an optimization of the backpropagation (BP) neural network, the Elman model inevitably inherits some of its inherent deficiencies, influencing the recognition precision and operating efficiency. Many improvements have been proposed to resolve these problems, but it has proved difficult to balance the many relevant features such as storage space, algorithm efficiency, recognition precision, etc. Also, it is difficult to obtain a permanent solution from a temporary solution simultaneously. To address this, a genetic algorithm (GA) can be introduced into the Elman algorithm to optimize the connection weights and thresholds, which can prevent the neural network from becoming trapped in local minima and improve the training speed and success rate. The structure of the hidden layer can also be optimized using the GA, which can solve the difficult problem of determining the number of neurons. Most previous studies on such evolutionary Elman algorithms optimized the connection weights or network structure individually, which represents a slight deficiency. We propose herein a novel optimized GA–Elman neural network algorithm where the connection weights are real-encoded, while the neurons of the hidden layer also adopt real-coding but with the addition of binary control genes. In this new algorithm, the connection weights and the number of hidden neurons are optimized using hybrid encoding and evolution simultaneously, greatly improving the performance of the resulting novel GA–Elman algorithm. The results of three experiments show that this new GA–Elman model is superior to the traditional model in terms of all calculated indexes.

A Modified Conjugate Gradient-Based Elman Neural Network

An Efficient Elman Neural Networks Based on Improved Conjugate Gradient Method with Generalized Armijo Search.

A Recalling-Enhanced Recurrent Neural Network: Conjugate Gradient Learning Algorithm and Its Convergence Analysis

Convergence of Gradient Method for Elman Networks

Convergence of approximated gradient method for Elman network

A novel optimized GA–Elman neural network algorithm

Research on Using Genetic Algorithms to Optimize Elman Neural Networks

A Novel Conjugate Gradient Method with Generalized Armijo Search for Efficient Training of Feedforward Neural Networks

The Conjugate Gradient Method with neural network control

Convergence Analysis of Regularized Elman Neural Networks under Relaxed Conditions

A New Conjugate Gradient Method with Smoothing L_1/2 Regularization Based on a Modified Secant Equation for Training Neural Networks

A Modified Elman Neural Network with a New Learning Rate Scheme.

An Improved Conjugate Gradient Neural Networks Based on a Generalized Armijo Search Method

An Algorithm Of Supervised Learning For Elman Neural Network

A New Conjugate Gradient Method with Smoothing $$L_{1/2} $$L1/2 Regularization Based on a Modified Secant Equation for Training Neural Networks

Variable three-term conjugate gradient method for training artificial neural networks

Quantum Gate Elman Neural Network and Its Quantized Extended Gradient Back-propagation Training Algorithm: Quantum Gate Elman Neural Network and Its Quantized Extended Gradient Back-propagation Training Algorithm

Adaptive Stochastic Conjugate Gradient Optimization for Backpropagation Neural Networks

An Efficient Generalized Single Hidden Layer Neural Networks Based on Conjugate Gradient Method

Improved GWO and Its Application in Parameter Optimization of Elman Neural Network.

Fully Complex Conjugate Gradient-Based Neural Networks Using Wirtinger Calculus Framework: Deterministic Convergence and Its Application.