Abstract:Time series analysis is the process of exploring and analyzing past trends to predict future events for any given time interval. Powered by recent advances in convolutional, recurrent and self-attention mechanisms, many deep learning methods have facilitated the investigation of time series forecasting. However, despite their effectiveness, it is doubtful that future trends can be accurately predicted due to the intricate temporal irregularities. Plus, time series frequently exhibit features at various time scales, but existing approaches do not adequately take this into account. To address above issues, this paper offers a new M ulti-scale A daptive attention-based T ime- V ariant neural N etworks (MATVN) for multi-step ahead time series forecasting. Specifically, we contribute a novel framework capable of capturing irregular dynamic behaviors observed in temporal data over time with a Time-Variant architecture. Furthermore, a newly proposed Multi-scale Multi-head Adaptive attention module is introduced into the Time-Variant architecture to encode temporal dependencies from various pre-defined scale-aware ranges. Additionally, we endow the proposed module with more flexible individual representation learning and scale-aware attention scopes for each token to better capture multi-scale temporal patterns by designing a new Adaptive Window-aware Mask strategy. Experimental results on the vast majority of application scenarios, including climatology and energy consumption, demonstrate that the proposed model outperforms a lot of recent state-of-the-art methods in multi-step time series forecasting tasks.

A Multiscale Interactive Recurrent Network for Time-Series Forecasting

Multivariate Time Series Forecasting Using Multiscale Recurrent Networks with Scale Attention and Cross-Scale Guidance.

Multi-Scale Adaptive Graph Neural Network for Multivariate Time Series Forecasting

Multi-Scale Adaptive Graph Neural Network for Multivariate Time Series Forecasting

Parallel Multi-Scale Dynamic Graph Neural Network for Multivariate Time Series Forecasting

Multi-scale adaptive attention-based time-variant neural networks for multi-step time series forecasting

Multi-Scale Information Granule-Based Time Series Forecasting Model with Two-Stage Prediction Mechanism

MPR-Net:Multi-Scale Pattern Reproduction Guided Universality Time Series Interpretable Forecasting

Multivariate Temporal Convolutional Network: A Deep Neural Networks Approach for Multivariate Time Series Forecasting

Deep Coupling Network For Multivariate Time Series Forecasting

A Neural Networks Based Method for Multivariate Time-Series Forecasting

Scale-Aware Neural Architecture Search for Multivariate Time Series Forecasting

Time-Aware Multi-Scale RNNs for Time Series Modeling

MSRN-Informer: Time Series Prediction Model Based on Multi-Scale Residual Network

MPPN: Multi-Resolution Periodic Pattern Network For Long-Term Time Series Forecasting

Cluster-aware attentive convolutional recurrent network for multivariate time-series forecasting

MMFNet: Multi-Scale Frequency Masking Neural Network for Multivariate Time Series Forecasting

A Multi-Granularity Hierarchical Network for Long- and Short-Term Forecasting on Multivariate Time Series Data

Learning the Evolutionary and Multi-scale Graph Structure for Multivariate Time Series Forecasting

MultiWaveNet: A Long Time Series Forecasting Framework Based on Multi-Scale Analysis and Multi-Channel Feature Fusion

Disentangling Structured Components: Towards Adaptive, Interpretable and Scalable Time Series Forecasting