Abstract:Time series data are prevalent in the real world, particularly playing a crucial role in key domains such as meteorology, electricity, and finance. Comprising observations at historical time points, these data, when subjected to in-depth analysis and modeling, enable researchers to predict future trends and patterns, providing support for decision making. In current research, especially in the analysis of long time series, effectively extracting and integrating long-term dependencies with short-term features remains a significant challenge. Long-term dependencies refer to the correlation between data points spaced far apart in a time series, while short-term features focus on more recent changes. Understanding and combining these two features correctly are crucial for constructing accurate and reliable predictive models. To efficiently extract and integrate long-term dependencies and short-term features in long time series, this paper proposes a pyramid attention structure model based on multi-scale feature extraction, referred to as the MSFformer model. Initially, a coarser-scale construction module is designed to obtain coarse-grained information. A pyramid data structure is constructed through feature convolution, with the bottom layer representing the original data and each subsequent layer containing feature information extracted across different time step lengths. As a result, nodes higher up in the pyramid integrate information from more time points, such as every Monday or the beginning of each month, while nodes lower down retain their individual information. Additionally, a Skip-PAM is introduced, where a node only calculates attention with its neighboring nodes, parent node, and child nodes, effectively reducing the model's time complexity to some extent. Notably, the child nodes refer to nodes selected from the next layer by skipping specific time steps. In this study, we not only propose an innovative time series prediction model but also validate the effectiveness of these methods through a series of comprehensive experiments. To comprehensively evaluate the performance of the designed model, we conducted comparative experiments with baseline models, ablation experiments, and hyperparameter studies. The experimental results demonstrate that the MSFformer model improves by 35.87% and 42.6% on the MAE and MSE indicators, respectively, compared to traditional Transformer models. These results highlight the outstanding performance of our proposed deep learning model in handling complex time series data, particularly in capturing long-term dependencies and integrating short-term features.

MSRN-Informer: Time Series Prediction Model Based on Multi-Scale Residual Network

Wind Speed Prediction Based on Multilevel Wavelet Decomposition Network

A Multiscale Interactive Recurrent Network for Time-Series Forecasting

Multivariate Time Series Forecasting Using Multiscale Recurrent Networks with Scale Attention and Cross-Scale Guidance.

A Multi-output Integration Residual Network for Predicting Time Series Data with Diverse Scales.

MS-RNN: A Flexible Multi-Scale Framework for Spatiotemporal Predictive Learning

CL-Informer: Long time series prediction model based on continuous wavelet transform

Time-Aware Multi-Scale RNNs for Time Series Modeling

MPPN: Multi-Resolution Periodic Pattern Network For Long-Term Time Series Forecasting

A Neural Networks Based Method for Multivariate Time-Series Forecasting

MPR-Net:Multi-Scale Pattern Reproduction Guided Universality Time Series Interpretable Forecasting

Multivariate Temporal Convolutional Network: A Deep Neural Networks Approach for Multivariate Time Series Forecasting

Power-Load Forecasting Model Based on Informer and Its Application

Adaptive Graph Convolutional Network Framework for Multidimensional Time Series Prediction

Multi-Scale Dilated Convolution Network for Long-Term Time Series Forecasting

MFTM-Informer: A Multi-Step Prediction Model Based on Multivariate Fuzzy Trend Matching and Informer

Multi-Step Forecasting Method Based on Recurrent Neural Networks Model

Time Series Prediction Based on Multi-Scale Feature Extraction

Long Time Series Deep Forecasting with Multiscale Feature Extraction and Seq2seq Attention Mechanism

Multivariate time series modeling and prediction based on reservoir independent components

MICN: Multi-scale Local and Global Context Modeling for Long-term Series Forecasting