Abstract:<p>Multivariate time series (MTS) prediction aims at predicting future time series by extracting multiple forms of dependencies of past time series. Traditional prediction methods and deep learning‐based prediction methods focus on extracting the dynamic relationships of certain aspects of MTS, especially the temporal characteristics, often neglecting the spatial and temporal dynamic correlations of MTS. Inspired by convolution neural network (CNN) and attention mechanism, this paper proposes a convolution LSTM network model based on MTS prediction with two‐stage attention. Specifically, we first propose a new MTS preprocessing method to perform convolution operations better. Then convolution layer extracts spatial correlation of MTS and LSTM model extracts temporal correlation. It is worth mentioning that the combination of attention mechanism and LSTM can effectively solve the problem of insufficient time dependency in MTS prediction. In addition, dual‐stage attention mechanism can effectively eliminate irrelevant information, select the relevant exogenous sequence, give it higher weight, and increase the past value of the target sequence to further eliminate irrelevant information. Finally, the MTS spatio‐temporal correlation is extracted to improve the prediction accuracy, and the model is interpreted. Experimental results show that the model has broad application prospects. Experiments based on typical datasets of finance, environment, and energy determine the optimal window size and hidden size of the prediction, and demonstrate that the model achieves the state‐of‐the‐art effect compared to the other four deep learning models. On top of that, the model is not only suitable for single‐step prediction of MTS, but also suitable for multistep prediction of time step in a certain range.</p>

Novel hybrid multi-head self-attention and multifractal algorithm for non-stationary time series prediction

Temporal Self-Attention-based Conv-LSTM Network for Multivariate Time Series Prediction

Multi-scale adaptive attention-based time-variant neural networks for multi-step time series forecasting

Self-attention-based time-variant neural networks for multi-step time series forecasting

A Multivariate Time Series Prediction Method Based on Convolution-Residual Gated Recurrent Neural Network and Double-Layer Attention

Multivariate time series forecasting method based on nonlinear spiking neural P systems and non-subsampled shearlet transform

Spatiotemporal Self-Attention-Based LSTNet for Multivariate Time Series Prediction

A novel hybrid deep learning time series forecasting model based on long-short-term patterns

Parallel spatio-temporal attention-based TCN for multivariate time series prediction

A dual‐stage attention‐based Conv‐LSTM network for spatio‐temporal correlation and multivariate time series prediction

Multistage attention network for multivariate time series prediction

Attention Based CNN-LSTM Network for Anomaly Pattern Classification of Multivariate Time Series

A Self-Attention Based Method for Wind Speed Forecasting in High-Speed Railway System

Temporal pattern attention for multivariate time series forecasting

Correlational graph attention-based Long Short-Term Memory network for multivariate time series prediction

CANet: Convolutional Attention-based Network for Multivariate Time Series Anomaly Detection

Attention-based multi-scale prediction network for time-series data

A dual-stage attention-based Bi-LSTM network for multivariate time series prediction

A hybrid framework for multivariate long-sequence time series forecasting

A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Prediction

Long Time Series Deep Forecasting with Multiscale Feature Extraction and Seq2seq Attention Mechanism