Abstract:Time series forecasting models that use the past information of exogenous or endogenous sequences to forecast future series play an important role in the real world because most real-world time series datasets are rich in time-dependent information. Most conventional prediction models for time series datasets are time-consuming and fraught with complex limitations because they usually fail to adequately exploit the latent spatial dependence between pairs of variables. As a successful variant of recurrent neural networks, the long short-term memory network (LSTM) has been demonstrated to have stronger nonlinear dynamics to store sequential data than traditional machine learning models. Nevertheless, the common shallow LSTM architecture has limited capacity to fully extract the transient characteristics of long interval sequential datasets. In this study, a novel deep autoregression feature augmented bidirectional LSTM network (DAFA-BiLSTM) is proposed as a new deep BiLSTM architecture for time series prediction. Initially, the input vectors are fed into a vector autoregression (VA) transformation module to represent the time-delayed linear and nonlinear properties of the input signals in an unsupervised way. Then, the learned nonlinear combination vectors of VA are progressively fed into different layers of BiLSTM and the output of the previous BiLSTM module is also concatenated with the time-delayed linear vectors of the VA as an augmented feature to form new additional input signals for the next adjacent BiLSTM layer. Extensive real-world time series applications are addressed to demonstrate the superiority and robustness of the proposed DAFA-BiLSTM. Comparative experimental results and statistical analysis show that the proposed DAFA-BiLSTM has good adaptive performance as well as robustness even in noisy environment.

Time Series Prediction Based on Time Attention Mechanism and LSTM Neural Network

Time Series Prediction Based on LSTM-Attention-LSTM Model

EA-LSTM: Evolutionary attention-based LSTM for time series prediction

Research on Short-Term Prediction of Typical Trial Sea Environment in China Based on LSTM Neural Network

Temporal Self-Attention-based Conv-LSTM Network for Multivariate Time Series Prediction

Attention-based multi-scale prediction network for time-series data

RAdam-DA-NLSTM: A Nested LSTM-Based Time Series Prediction Method for Human–Computer Intelligent Systems

Effective LSTMs with Seasonal-Trend Decomposition and Adaptive Learning and Niching-Based Backtracking Search Algorithm for Time Series Forecasting

Improving time series forecasting using LSTM and attention models

AT-LSTM: An Attention-based LSTM Model for Financial Time Series Prediction

Deep Learning with Long Short-Term Memory for Time Series Prediction

Data Science Analysis Method Design via Big Data Technology and Attention Neural Network

Hydrological Time Series Prediction Model Based on Attention-LSTM Neural Network

Time-series prediction model of PM2.5 concentration based on LSTM neural network

A dual-stage attention-based Bi-LSTM network for multivariate time series prediction

Time Series Analysis Based Air Pollution Level Prediction Using Long Short Term Memory Recurrent Neural Network with Attention Mechanism

Time Series Prediction Based on LSTM and High-Order Fuzzy Cognitive Map with Attention Mechanism

DAFA-BiLSTM: Deep Autoregression Feature Augmented Bidirectional LSTM network for time series prediction

Spatiotemporal Self-Attention-Based LSTNet for Multivariate Time Series Prediction

Temporal pattern attention for multivariate time series forecasting

Time Series Prediction Method Based on Variant LSTM Recurrent Neural Network