Abstract:Time series forecasting models that use the past information of exogenous or endogenous sequences to forecast future series play an important role in the real world because most real-world time series datasets are rich in time-dependent information. Most conventional prediction models for time series datasets are time-consuming and fraught with complex limitations because they usually fail to adequately exploit the latent spatial dependence between pairs of variables. As a successful variant of recurrent neural networks, the long short-term memory network (LSTM) has been demonstrated to have stronger nonlinear dynamics to store sequential data than traditional machine learning models. Nevertheless, the common shallow LSTM architecture has limited capacity to fully extract the transient characteristics of long interval sequential datasets. In this study, a novel deep autoregression feature augmented bidirectional LSTM network (DAFA-BiLSTM) is proposed as a new deep BiLSTM architecture for time series prediction. Initially, the input vectors are fed into a vector autoregression (VA) transformation module to represent the time-delayed linear and nonlinear properties of the input signals in an unsupervised way. Then, the learned nonlinear combination vectors of VA are progressively fed into different layers of BiLSTM and the output of the previous BiLSTM module is also concatenated with the time-delayed linear vectors of the VA as an augmented feature to form new additional input signals for the next adjacent BiLSTM layer. Extensive real-world time series applications are addressed to demonstrate the superiority and robustness of the proposed DAFA-BiLSTM. Comparative experimental results and statistical analysis show that the proposed DAFA-BiLSTM has good adaptive performance as well as robustness even in noisy environment.

Adaptive Temporal-Frequency Network for Time-Series Forecasting

Adaptive Multi-Scale TF-net for High-Resolution Time-Frequency Representations

ATFNet: Adaptive Time-Frequency Ensembled Network for Long-term Time Series Forecasting

QTFN: A General End-to-End Time-Frequency Network to Reveal the Time-Varying Signatures of the Time Series

Boost Spectrum Prediction with Temporal-Frequency Fusion Network Via Transfer Learning

Adaptive Convolutional Forecasting Network Based on Time Series Feature-Driven

TFDNet: Time-Frequency Enhanced Decomposed Network for Long-term Time Series Forecasting

TF(2)AN: A Temporal-Frequency Fusion Attention Network for Spectrum Energy Level Prediction

Multi-scale adaptive attention-based time-variant neural networks for multi-step time series forecasting

Spatiotemporal Adaptive Neural Network for Long-term Forecasting of Financial Time Series

A novel hybrid deep learning time series forecasting model based on long-short-term patterns

Dual‐stage time series analysis on multifeature adaptive frequency domain modeling

MFF-FTNet: Multi-scale Feature Fusion across Frequency and Temporal Domains for Time Series Forecasting

FL-Net: A multi-scale cross-decomposition network with frequency external attention for long-term time series forecasting

Forecasting Wavelet Transformed Time Series with Attentive Neural Networks.

W-FENet: Wavelet-based Fourier-Enhanced Network Model Decomposition for Multivariate Long-Term Time-Series Forecasting

MMFNet: Multi-Scale Frequency Masking Neural Network for Multivariate Time Series Forecasting

TLNets: Transformation Learning Networks for long-range time-series prediction

GAFNO: Gated Adaptive Fourier Neural Operator for Task-Agnostic Time Series Modeling

Frequency Adaptive Normalization For Non-stationary Time Series Forecasting

DAFA-BiLSTM: Deep Autoregression Feature Augmented Bidirectional LSTM network for time series prediction