Abstract:The non-stationary nature of real-world Multivariate Time Series (MTS) data presents forecasting models with a formidable challenge of the time-variant distribution of time series, referred to as distribution shift. Existing studies on the distribution shift mostly adhere to adaptive normalization techniques for alleviating temporal mean and covariance shifts or time-variant modeling for capturing temporal shifts. Despite improving model generalization, these normalization-based methods often assume a time-invariant transition between outputs and inputs but disregard specific intra-/inter-series correlations, while time-variant models overlook the intrinsic causes of the distribution shift. This limits model expressiveness and interpretability of tackling the distribution shift for MTS forecasting. To mitigate such a dilemma, we present a unified Probabilistic Graphical Model to Jointly capturing intra-/inter-series correlations and modeling the time-variant transitional distribution, and instantiate a neural framework called JointPGM for non-stationary MTS forecasting. Specifically, JointPGM first employs multiple Fourier basis functions to learn dynamic time factors and designs two distinct learners: intra-series and inter-series learners. The intra-series learner effectively captures temporal dynamics by utilizing temporal gates, while the inter-series learner explicitly models spatial dynamics through multi-hop propagation, incorporating Gumbel-softmax sampling. These two types of series dynamics are subsequently fused into a latent variable, which is inversely employed to infer time factors, generate final prediction, and perform reconstruction. We validate the effectiveness and efficiency of JointPGM through extensive experiments on six highly non-stationary MTS datasets, achieving state-of-the-art forecasting performance of MTS forecasting.

Hidden Markov Mixture of Gaussian Process Functional Regression: Utilizing Multi-Scale Structure for Time Series Forecasting

A Two-Layer Mixture Model of Gaussian Process Functional Regressions and Its MCMC EM Algorithm

Dynamic Gaussian Mixture based Deep Generative Model For Robust Forecasting on Sparse Multivariate Time Series

Monthly Streamflow Forecasting Based on Hidden Markov Model and Gaussian Mixture Regression

Learning Gaussian Mixture Representations for Tensor Time Series Forecasting

Multi-Scale Information Granule-Based Time Series Forecasting Model with Two-Stage Prediction Mechanism

Parallel Multi-Scale Dynamic Graph Neural Network for Multivariate Time Series Forecasting

Automated Model Selection of the Two-Layer Mixtures of Gaussian Process Functional Regressions for Curve Clustering and Prediction

Robust Multivariate Time Series Forecasting against Intra- and Inter-Series Transitional Shift

Synergetic Learning of Heterogeneous Temporal Sequences for Multi-Horizon Probabilistic Forecasting

Multi-Step Time Series Forecasting with an Ensemble of Varied Length Mixture Models.

Gaussian processes with skewed Laplace spectral mixture kernels for long-term forecasting

Hidden Markov Models Based Approaches to Long-Term Prediction for Granular Time Series.

Mixture of Gaussian Processes and its Applications

Spatio-temporal DeepKriging for Interpolation and Probabilistic Forecasting

Automatic Model Selection Algorithm Based on BYY Harmony Learning for Mixture of Gaussian Process Functional Regressions Models.

Middle and Long-Term Runoff Probabilistic Forecasting Based on Gaussian Mixture Regression

MTHetGNN: A Heterogeneous Graph Embedding Framework for Multivariate Time Series Forecasting

A Multi-View Multi-Task Learning Framework for Multi-Variate Time Series Forecasting

Linear Time GPs for Inferring Latent Trajectories from Neural Spike Trains

Learning and Integration of Adaptive Hybrid Graph Structures for Multivariate Time Series Forecasting.