Abstract:Recently, the development of deep learning technology has promoted the wide application of machine learning. In particular, the technique known as reservoir computing has attracted more and more attention due to its excellent behavior on chaotic time series prediction, and has formed a new research hotspot. In this paper, we use traditional long short-term memory (LSTM) neural networks and fully connected layers as the fundamental elements to build a LSTM learning machine based on the recurrent neural network architecture. The motivation for using LSTM is that it can effectively prevent the vanishing and exploding of gradients. In the simulation experiment, we quantify the duration of accurate prediction with the average valid time and use the model to predict the state of Lorenz system. Aiming at the special dynamic properties of chaotic system, we propose four strategies to assist prediction, which are normalization and restoration, scaling down the gradients, reservoir-based initialization and preserving the optimal model. The results show that the prediction ability of the LSTM learning machine with suitable strategies is comparable to that of reservoir computing, furthermore, the complexity of the LSTM is lower. Therefore, our results indicate that there is no obvious evidence that reservoir computing can surpass the traditional method, which inspires us to further study the mechanism and methods of learning machine for predicting time series, and find more effective learning machines.

A Homotopy Gated Recurrent Unit for Predicting High Dimensional Hyperchaos

The Temperature Prediction of Hydro-generating Units based on Temporal Convolutional Network and Recurrent Neural Network

Chaotic Time Series Prediction Based on Long Short-Term Memory Neural Networks

Frequency-hopping Prediction Based on the Chaotic Neural Network

Chaotic Time Series Prediction Using DTIGNet Based on Improved Temporal-Inception and GRU

Prediction of Chaotic Time Series Based on the Recurrent Predictor Neural Network

Predicting Chaotic Time Series and Replicating Chaotic Attractors Based on Two Novel Echo State Network Models

Chaotic Neural Network Approach to Chaotic Time Series Prediction

Long-term prediction of chaotic systems with recurrent neural networks

Higher-order Granger reservoir computing: simultaneously achieving scalable complex structures inference and accurate dynamics prediction

High-efficiency Chaotic Time Series Prediction Based on Time Convolution Neural Network

Multivariate Chaotic Time Series Prediction Based on Hierarchic Reservoirs

A Hybrid Model Based on a Two-Layer Decomposition Approach and an Optimized Neural Network for Chaotic Time Series Prediction

Gated recurrent units viewed through the lens of continuous time dynamical systems

Time Series Prediction Based on Chaotic Attractor

Predicting Chaotic System Behavior using Machine Learning Techniques

Chaotic Time Series Prediction Based on Evolving Recurrent Neural Networks

Routing Hypergraph Convolutional Recurrent Network for Network Traffic Prediction

Hierarchically Gated Recurrent Neural Network for Sequence Modeling

Recognizing Chaos by Deep Learning and Transfer Learning on Recurrence Plots

Long-term Prediction of Chaotic Systems with Machine Learning