Abstract:<p>Multivariate time series (MTS) prediction aims at predicting future time series by extracting multiple forms of dependencies of past time series. Traditional prediction methods and deep learning‐based prediction methods focus on extracting the dynamic relationships of certain aspects of MTS, especially the temporal characteristics, often neglecting the spatial and temporal dynamic correlations of MTS. Inspired by convolution neural network (CNN) and attention mechanism, this paper proposes a convolution LSTM network model based on MTS prediction with two‐stage attention. Specifically, we first propose a new MTS preprocessing method to perform convolution operations better. Then convolution layer extracts spatial correlation of MTS and LSTM model extracts temporal correlation. It is worth mentioning that the combination of attention mechanism and LSTM can effectively solve the problem of insufficient time dependency in MTS prediction. In addition, dual‐stage attention mechanism can effectively eliminate irrelevant information, select the relevant exogenous sequence, give it higher weight, and increase the past value of the target sequence to further eliminate irrelevant information. Finally, the MTS spatio‐temporal correlation is extracted to improve the prediction accuracy, and the model is interpreted. Experimental results show that the model has broad application prospects. Experiments based on typical datasets of finance, environment, and energy determine the optimal window size and hidden size of the prediction, and demonstrate that the model achieves the state‐of‐the‐art effect compared to the other four deep learning models. On top of that, the model is not only suitable for single‐step prediction of MTS, but also suitable for multistep prediction of time step in a certain range.</p>

Multi-task LS-SVM for application of time series prediction

Multivariate time series classification based on μσ-DWC feature and tree-structured M-SVM

Effective LSTMs with Seasonal-Trend Decomposition and Adaptive Learning and Niching-Based Backtracking Search Algorithm for Time Series Forecasting

Weighted prediction method with multiple time series using multi-kernel least squares support vector regression

A Novel Hybrid Scheme for Time Series Prediction Using LMS Filter and ISSA-based LSTM.

A Deep Multi-Task Representation Learning Method for Time Series Classification and Retrieval.

Application of online multitask learning based on least squares support vector regression in the financial market

Multi-task least-squares support vector machines

The Als-Svm Based Multi-Task Learning Classifiers

A dual‐stage attention‐based Conv‐LSTM network for spatio‐temporal correlation and multivariate time series prediction

Multivariate prediction of retail sales by multi-task time series learning

A Multi-View Multi-Task Learning Framework for Multi-Variate Time Series Forecasting

Temporal Self-Attention-based Conv-LSTM Network for Multivariate Time Series Prediction

A dual-stage attention-based Bi-LSTM network for multivariate time series prediction

Multi-Task Learning for Time Series Forecasting Using NARMAX-LSTM

Deep Multi-Task Learning Model for Time Series Prediction in Wireless Communication

Multitask Learning Based on Least Squares Support Vector Regression for Stock Forecast

Multi-task Learning for Landslide Displacement Prediction

Multi-task Least Squares Twin Support Vector Machine for Classification

Multitask Learning for Time Series Data with 2D Convolution