Abstract:Time series classification and forecasting have long been studied with the traditional statistical methods. Recently, deep learning achieved remarkable successes in areas such as image, text, video, audio processing, etc. However, research studies conducted with deep neural networks in these fields are not abundant. Therefore, in this paper, we aim to propose and evaluate several state-of-the-art neural network models in these fields. We first review the basics of representative models, namely long short-term memory and its variants, the temporal convolutional network and the generative adversarial network. Then, long short-term memory with autoencoder and attention-based models, the temporal convolutional network and the generative adversarial model are proposed and applied to time series classification and forecasting. Gaussian sliding window weights are proposed to speed the training process up. Finally, the performances of the proposed methods are assessed using five optimizers and loss functions with the public benchmark datasets, and comparisons between the proposed temporal convolutional network and several classical models are conducted. Experiments show the proposed models’ effectiveness and confirm that the temporal convolutional network is superior to long short-term memory models in sequence modeling. We conclude that the proposed temporal convolutional network reduces time consumption to around 80% compared to others while retaining the same accuracy. The unstable training process for generative adversarial network is circumvented by tuning hyperparameters and carefully choosing the appropriate optimizer of “Adam”. The proposed generative adversarial network also achieves comparable forecasting accuracy with traditional methods.

A New Optimization Algorithm for Non-Stationary Time Series Prediction Based on Recurrent Neural Networks.

A Gradient RBF Network Based on Multi-Innovation Algorithm for Nonstationary Time Series Prediction

Nonparametric Stochastic Differential Equations for Ultra-Short-Term Probabilistic Forecasting of Wind Power Generation

Nonstationary Time Series Prediction Based on Deep Echo State Network Tuned by Bayesian Optimization

A Method of Load Forecasting Based on Temporal Convolutional Network

Effective Neural Network Training with a New Weighting Mechanism-Based Optimization Algorithm.

A New Recursive Kernel Regression Algorithm and Its Application in Ultra-short Time Power Load Forecasting

An Efficient Dynamic Neural Network for Predicting Time Series Data Stream

Prediction of Chaotic Time Series Based on Neural Network Optimized by Hybrid Algorithm

Intelligent Optimization Prediction Algorithm for Statistical Data Based on Recurrent Neural Network

A new hybrid recurrent artificial neural network for time series forecasting

Time Series Forecasting and Classification Models Based on Recurrent with Attention Mechanism and Generative Adversarial Networks

Recursive Prediction Algorithm for Non-Stationary Gaussian Process

An Improved Training Algorithm of Neural Networks for Time Series Forecasting

A hybrid algorithm to optimize RBF network architecture and parameters for nonlinear time series prediction

NonSTOP: A NonSTationary Online Prediction Method for Time Series

An Adaptive Continual Learning Method for Nonstationary Industrial Time Series Prediction

Robust Online Time Series Prediction with Recurrent Neural Networks

Stochastic Recurrent Neural Network for Multistep Time Series Forecasting

A Denoising Time Window Algorithm for Optimizing LSTM Prediction

Dynamic Neural Network Based Genetic Algorithm Optimizing for Short Term Load Forecasting