Abstract:Multivariate time series forecasting plays a crucial role in various real-world applications. Significant efforts have been made to integrate advanced network architectures and training strategies that enhance the capture of temporal dependencies, thereby improving forecasting accuracy. On the other hand, mainstream approaches typically utilize a single unified model with simplistic channel-mixing embedding or cross-channel attention operations to account for the critical intricate inter-channel dependencies. Moreover, some methods even trade capacity for robust prediction based on the channel-independent assumption. Nonetheless, as time series data may display distinct evolving patterns due to the unique characteristics of each channel (including multiple strong seasonalities and trend changes), the unified modeling methods could yield suboptimal results. To this end, we propose DisenTS, a tailored framework for modeling disentangled channel evolving patterns in general multivariate time series forecasting. The central idea of DisenTS is to model the potential diverse patterns within the multivariate time series data in a decoupled manner. Technically, the framework employs multiple distinct forecasting models, each tasked with uncovering a unique evolving pattern. To guide the learning process without supervision of pattern partition, we introduce a novel Forecaster Aware Gate (FAG) module that generates the routing signals adaptively according to both the forecasters' states and input series' characteristics. The forecasters' states are derived from the Linear Weight Approximation (LWA) strategy, which quantizes the complex deep neural networks into compact matrices. Additionally, the Similarity Constraint (SC) is further proposed to guide each model to specialize in an underlying pattern by minimizing the mutual information between the representations.

Combining Global and Sequential Patterns for Multivariate Time Series Forecasting.

Generalizable Memory-driven Transformer for Multivariate Long Sequence Time-series Forecasting

Revitalizing Multivariate Time Series Forecasting: Learnable Decomposition with Inter-Series Dependencies and Intra-Series Variations Modeling

Parallel Extraction of Long-term Trends and Short-term Fluctuation Framework for Multivariate Time Series Forecasting

TDG4MSF: A temporal decomposition enhanced graph neural network for multivariate time series forecasting

A Pattern Discovery Approach to Multivariate Time Series Forecasting

Multivariate Time Series Modeling and Forecasting with Parallelized Convolution and Decomposed Sparse-Transformer

Leveraging 2D Information for Long-term Time Series Forecasting with Vanilla Transformers

Multivariate Time Series Forecasting Based on Causal Inference with Transfer Entropy and Graph Neural Network

Enhancing Multivariate Time Series Forecasting with Mutual Information-driven Cross-Variable and Temporal Modeling

UniTST: Effectively Modeling Inter-Series and Intra-Series Dependencies for Multivariate Time Series Forecasting

Disentangling Structured Components: Towards Adaptive, Interpretable and Scalable Time Series Forecasting

DisenTS: Disentangled Channel Evolving Pattern Modeling for Multivariate Time Series Forecasting

CATS: Enhancing Multivariate Time Series Forecasting by Constructing Auxiliary Time Series as Exogenous Variables

Deep Coupling Network For Multivariate Time Series Forecasting

A Novel Encoder-Decoder Model for Multivariate Time Series Forecasting

Spatial-Temporal Convolutional Transformer Network for Multivariate Time Series Forecasting

GCformer: an Efficient Solution for Accurate and Scalable Long-Term Multivariate Time Series Forecasting

Pre-training Enhanced Spatial-temporal Graph Neural Network for Multivariate Time Series Forecasting

TV-Net: Temporal-Variable feature harmonizing Network for multivariate time series classification and interpretation

Biased Temporal Convolution Graph Network for Time Series Forecasting with Missing Values.