Abstract:Multivariate time series forecasting aims to predict time series data comprising several linked variables or characteristicsand is frequently used in stock forecasting, energy forecasting, etc. The tough task is to acquire furtherhistorical data to forecast future values while boosting the capacity to mine relationships between and within sequences. The existing methods neglect the weighted influence of various neighbors and relationships on the sequence instance, as well as the semantic information of the instance itself, making the inter-instance correlation measure inaccurate. Meanwhile, the length of the sequence input is limited and the variable features in the multivariate sequence are treated equally, short-term and multi-feature interference cannot be eliminated, causing the learnt time series features to deviate from the real features. In this work, we provide a Multivariate Time Series Forecasting model that emphasizes Relationships between and within sequences (MTSFR). Use the BERT model to characterize the text attributes of instances and construct basic semantic embeddings. Meanwhile, instance-level and relation-level attention are used to model topological relations among different instances. Computes the cross-correlation of multivariate sequences within instances and performs attention weighting for multivariate sequence encoding. And choose the Transformer model to realize the trend prediction of long-term multivariate series. Experimental results show that the F1 value of our approach achieves 68.50% and 74.66% under the CSI300 and S&P500 data sets respectively, both of which are superior to the SOTA technique. Furthermore, the model is suited for small-scale sequence relationship modeling and is effective at handling long-term multivariate sequence forecasting problems.

Introducing Spectral Attention for Long-Range Dependency in Time Series Forecasting

Sequence Attention for Multivariate Time Series Forecasting

Periodformer: an Efficient Long-Term Time Series Forecasting Method Based on Periodic Attention

Bidformer: A Transformer-Based Model Via Bidirectional Sparse Self-Attention Mechanism for Long Sequence Time-Series Forecasting

Detformer: Detect the Reliable Attention Index for Ultra-long Time Series Forecasting.

SDformer: Transformer with Spectral Filter and Dynamic Attention for Multivariate Time Series Long-term Forecasting

Adapt to Small-Scale and Long-Term Time Series Forecasting with Enhanced Multidimensional Correlation

TFformer: A Time-Frequency Domain Bidirectional Sequence-Level Attention Based Transformer for Interpretable Long-Term Sequence Forecasting

Temporal pattern attention for multivariate time series forecasting

Attention as Robust Representation for Time Series Forecasting

Does Long-Term Series Forecasting Need Complex Attention and Extra Long Inputs?

Revitalizing Multivariate Time Series Forecasting: Learnable Decomposition with Inter-Series Dependencies and Intra-Series Variations Modeling

Time Series Prediction Based on LSTM-Attention-LSTM Model

Time-Series Forecasting with Shape Attention.

Long Time Series Deep Forecasting with Multiscale Feature Extraction and Seq2seq Attention Mechanism

Temporal Chain Network with Intuitive Attention Mechanism for Long-Term Series Forecasting.

LSEAttention is All You Need for Time Series Forecasting

Make Active Attention More Active: Using Lipschitz Regularity to Improve Long Sequence Time-Series Forecasting.

SALSTM: Segmented Self-Attention Long Short-Term Memory for Long-Term Forecasting

Revisiting Attention for Multivariate Time Series Forecasting

Temporal Attention Based TCN-BIGRU Model for Energy Time Series Forecasting