Abstract:Time series forecasting models that use the past information of exogenous or endogenous sequences to forecast future series play an important role in the real world because most real-world time series datasets are rich in time-dependent information. Most conventional prediction models for time series datasets are time-consuming and fraught with complex limitations because they usually fail to adequately exploit the latent spatial dependence between pairs of variables. As a successful variant of recurrent neural networks, the long short-term memory network (LSTM) has been demonstrated to have stronger nonlinear dynamics to store sequential data than traditional machine learning models. Nevertheless, the common shallow LSTM architecture has limited capacity to fully extract the transient characteristics of long interval sequential datasets. In this study, a novel deep autoregression feature augmented bidirectional LSTM network (DAFA-BiLSTM) is proposed as a new deep BiLSTM architecture for time series prediction. Initially, the input vectors are fed into a vector autoregression (VA) transformation module to represent the time-delayed linear and nonlinear properties of the input signals in an unsupervised way. Then, the learned nonlinear combination vectors of VA are progressively fed into different layers of BiLSTM and the output of the previous BiLSTM module is also concatenated with the time-delayed linear vectors of the VA as an augmented feature to form new additional input signals for the next adjacent BiLSTM layer. Extensive real-world time series applications are addressed to demonstrate the superiority and robustness of the proposed DAFA-BiLSTM. Comparative experimental results and statistical analysis show that the proposed DAFA-BiLSTM has good adaptive performance as well as robustness even in noisy environment.

Long-term Time Series Prediction Based on Deep Denoising Recurrent Temporal Restricted Boltzmann Machine Network

DSTED: A Denoising Spatial–Temporal Encoder–Decoder Framework for Multistep Prediction of Burn-Through Point in Sintering Process

The Temperature Prediction of Hydro-generating Units based on Temporal Convolutional Network and Recurrent Neural Network

A study on time series prediction model based on CRBM algorithm

Study on State of Health of Power Battery Prediction Using Denoising Autoencoder and Bidirectional Long Short-Term Memory Networks

DWT denoising for multi-variate time series forecasting

A Hybrid Wind Speed Prediction Approach Based on Ensemble Empirical Mode Decomposition and BO-LSTM Neural Networks for Digital Twin

Probabilistic Sequential Network for Deep Learning of Complex Process Data and Soft Sensor Application

A Denoising Time Window Algorithm for Optimizing LSTM Prediction

Time-series Prediction Based on VMD and Stack Recurrent Neural Network.

DAFA-BiLSTM: Deep Autoregression Feature Augmented Bidirectional LSTM network for time series prediction

Prediction of financial time series using LSTM and data denoising methods

Intelligent Optimization Prediction Algorithm for Statistical Data Based on Recurrent Neural Network

Time Series Prediction Based on Temporal Convolutional Network

DSTP-RNN: A Dual-Stage Two-Phase Attention-Based Recurrent Neural Network for Long-Term and Multivariate Time Series Prediction

Improved echo state network based on data-driven and its application to prediction of blast furnace gas output

DDTCN: Decomposed dimension time-domain convolutional neural network along spatial dimensions for multiple long-term series forecasting

Dynamic data reconciliation for enhancing the prediction performance of long short-term memory network

Network-Based Layered Architecture for Long-Term Prediction

A Spatiotemporal Prediction Framework for Air Pollution Based on Deep RNN

Ultra-short-term Wind Power Forecasting Based on Deep Belief Network and Wavelet Denoising