Abstract:Time series forecasting models that use the past information of exogenous or endogenous sequences to forecast future series play an important role in the real world because most real-world time series datasets are rich in time-dependent information. Most conventional prediction models for time series datasets are time-consuming and fraught with complex limitations because they usually fail to adequately exploit the latent spatial dependence between pairs of variables. As a successful variant of recurrent neural networks, the long short-term memory network (LSTM) has been demonstrated to have stronger nonlinear dynamics to store sequential data than traditional machine learning models. Nevertheless, the common shallow LSTM architecture has limited capacity to fully extract the transient characteristics of long interval sequential datasets. In this study, a novel deep autoregression feature augmented bidirectional LSTM network (DAFA-BiLSTM) is proposed as a new deep BiLSTM architecture for time series prediction. Initially, the input vectors are fed into a vector autoregression (VA) transformation module to represent the time-delayed linear and nonlinear properties of the input signals in an unsupervised way. Then, the learned nonlinear combination vectors of VA are progressively fed into different layers of BiLSTM and the output of the previous BiLSTM module is also concatenated with the time-delayed linear vectors of the VA as an augmented feature to form new additional input signals for the next adjacent BiLSTM layer. Extensive real-world time series applications are addressed to demonstrate the superiority and robustness of the proposed DAFA-BiLSTM. Comparative experimental results and statistical analysis show that the proposed DAFA-BiLSTM has good adaptive performance as well as robustness even in noisy environment.

Time-series Prediction Based on VMD and Stack Recurrent Neural Network.

Time Series Prediction Method Based on Variant LSTM Recurrent Neural Network

A Hybrid Model for Time Series Prediction Using Adaptive Variational Mode Decomposition

A Temporal Window Attention-Based Window-Dependent Long Short-Term Memory Network for Multivariate Time Series Prediction.

DSTP-RNN: A Dual-Stage Two-Phase Attention-Based Recurrent Neural Network for Long-Term and Multivariate Time Series Prediction

DSTP-RNN: a dual-stage two-phase attention-based recurrent neural networks for long-term and multivariate time series prediction

CNN-LSTM-VAE Based Time Series Trend Prediction

Hierarchical Neural Networks for Multivariate Time Series Prediction

Multivariate time series modeling and prediction based on reservoir independent components

Prediction of Landslide Displacement Based on the Combined VMD-Stacked LSTM-TAR Model

A Neural Networks Based Method for Multivariate Time-Series Forecasting

Solving the Temporal Lags in Local Significant Wave Height Prediction with a New VMD-LSTM Model

STDNet: A Spatio-Temporal Decomposition Neural Network for Multivariate Time Series Forecasting

Stochastic Recurrent Neural Network for Multistep Time Series Forecasting

A Combination Model for Time Series Prediction using LSTM via Extracting Dynamic Features Based on Spatial Smoothing and Sequential General Variational Mode Decomposition

Long-term Time Series Prediction Based on Deep Denoising Recurrent Temporal Restricted Boltzmann Machine Network

Time Series Forecasting with Stacked Long Short-Term Memory Networks

TSARNet :Integrated Spatio-Temporal Attention Mechanism for Multivariate Time Series Prediction Deep Learning Framework

Temporal Self-Attention-based Conv-LSTM Network for Multivariate Time Series Prediction

DAFA-BiLSTM: Deep Autoregression Feature Augmented Bidirectional LSTM network for time series prediction

Time Series of Landslide Displacement Prediction based on VMD-LSTM