Abstract:Recently, the development of deep learning technology has promoted the wide application of machine learning. In particular, the technique known as reservoir computing has attracted more and more attention due to its excellent behavior on chaotic time series prediction, and has formed a new research hotspot. In this paper, we use traditional long short-term memory (LSTM) neural networks and fully connected layers as the fundamental elements to build a LSTM learning machine based on the recurrent neural network architecture. The motivation for using LSTM is that it can effectively prevent the vanishing and exploding of gradients. In the simulation experiment, we quantify the duration of accurate prediction with the average valid time and use the model to predict the state of Lorenz system. Aiming at the special dynamic properties of chaotic system, we propose four strategies to assist prediction, which are normalization and restoration, scaling down the gradients, reservoir-based initialization and preserving the optimal model. The results show that the prediction ability of the LSTM learning machine with suitable strategies is comparable to that of reservoir computing, furthermore, the complexity of the LSTM is lower. Therefore, our results indicate that there is no obvious evidence that reservoir computing can surpass the traditional method, which inspires us to further study the mechanism and methods of learning machine for predicting time series, and find more effective learning machines.

Application Research of Chaotic Time Series Prediction Based on PMLP Neural Network

A PMLP BASED METHOD FOR CHAOTIC TIME SERIES PREDICTION

Chaotic Time Series Prediction and Its Application Based on Wavelet Neural Network

Application of Parallel RBF Network on Iterative Prediction of Chaotic Time Series

Simulation and application research of chaotic time series prediction based on RBF neural network

Chaotic Neural Network Approach to Chaotic Time Series Prediction

Prediction of Chaotic Time Series Based on the Recurrent Predictor Neural Network

Multivariate Chaotic Time Series Prediction Based on PLSR and MKELM

Prediction of Chaotic Time Series Based on Emd Method

Prediction Of Multivariate Chaotic Time Series Based On Optimized Phase Space Reconstruction

A Chaotic Time Series Prediction Method Based on Fuzzy Neural Network and Its Application

A Hybrid Model Based on a Two-Layer Decomposition Approach and an Optimized Neural Network for Chaotic Time Series Prediction

n-Dimensional Chaotic Time Series Prediction Method

Multi-step Prediction of Chaotic Time Series Using the Least Squares Support Vector Machines

Chaotic Time Series Prediction Based on Long Short-Term Memory Neural Networks

Chaotic time series prediction based on fuzzy neural network

Study on Chaotic Prediction for Multi-branch Time Delay Neural Network

Novel hidden feature extraction method for chaotic time series prediction

Analysis and modeling of multivariate chaotic time series based on neural network

Chaotic Time Series Prediction Based on Evolving Recurrent Neural Networks

Time Series Prediction Based on Chaotic Attractor