Abstract:Time series forecasting models that use the past information of exogenous or endogenous sequences to forecast future series play an important role in the real world because most real-world time series datasets are rich in time-dependent information. Most conventional prediction models for time series datasets are time-consuming and fraught with complex limitations because they usually fail to adequately exploit the latent spatial dependence between pairs of variables. As a successful variant of recurrent neural networks, the long short-term memory network (LSTM) has been demonstrated to have stronger nonlinear dynamics to store sequential data than traditional machine learning models. Nevertheless, the common shallow LSTM architecture has limited capacity to fully extract the transient characteristics of long interval sequential datasets. In this study, a novel deep autoregression feature augmented bidirectional LSTM network (DAFA-BiLSTM) is proposed as a new deep BiLSTM architecture for time series prediction. Initially, the input vectors are fed into a vector autoregression (VA) transformation module to represent the time-delayed linear and nonlinear properties of the input signals in an unsupervised way. Then, the learned nonlinear combination vectors of VA are progressively fed into different layers of BiLSTM and the output of the previous BiLSTM module is also concatenated with the time-delayed linear vectors of the VA as an augmented feature to form new additional input signals for the next adjacent BiLSTM layer. Extensive real-world time series applications are addressed to demonstrate the superiority and robustness of the proposed DAFA-BiLSTM. Comparative experimental results and statistical analysis show that the proposed DAFA-BiLSTM has good adaptive performance as well as robustness even in noisy environment.

A Novel Model Based on DA-RNN Network and Skip Gated Recurrent Neural Network for Periodic Time Series Forecasting

A Novel Sequence-to-Sequence-Based Deep Learning Model for Multistep Load Forecasting.

A novel hybrid deep learning time series forecasting model based on long-short-term patterns

Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networks

Effective LSTMs with Seasonal-Trend Decomposition and Adaptive Learning and Niching-Based Backtracking Search Algorithm for Time Series Forecasting

Features Injected Recurrent Neural Networks for Short-Term Traffic Speed Prediction.

DAFA-BiLSTM: Deep Autoregression Feature Augmented Bidirectional LSTM network for time series prediction

Dense Skip Attention based Deep Learning for Day-Ahead Electricity Price Forecasting

Deep State Space Recurrent Neural Networks for Time Series Forecasting

A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Prediction

A novel broad learning system integrated with restricted Boltzmann machine and echo state network for time series forecasting

Recurrent Neural Networks for Forecasting Time Series with Multiple Seasonality: A Comparative Study

A Time Series Forecasting Approach Based on Nonlinear Spiking Neural Systems

DPHM-Net:de-redundant multi-period hybrid modeling network for long-term series forecasting

A Multiscale Interactive Recurrent Network for Time-Series Forecasting

Efficient and Effective Time-Series Forecasting with Spiking Neural Networks

A novel ensemble deep learning model with dynamic error correction and multi-objective ensemble pruning for time series forecasting

Periodicity Decoupling Framework for Long-term Series Forecasting

Deep Learning Based Recurrent Neural Networks to Enhance the Performance of Wind Energy Forecasting: A Review

Short-term Load Forecasting with Deep Residual Networks

Time Series Forecasting and Classification Models Based on Recurrent with Attention Mechanism and Generative Adversarial Networks