Abstract:Recent years have witnessed the success of introducing deep learning models to time series forecasting. From a data generation perspective, we illustrate that existing models are susceptible to distribution shifts driven by temporal contexts, whether observed or unobserved. Such context-driven distribution shift (CDS) introduces biases in predictions within specific contexts and poses challenges for conventional training paradigms. In this paper, we introduce a universal calibration methodology for the detection and adaptation of CDS with a trained model. To this end, we propose a novel CDS detector, termed the "residual-based CDS detector" or "Reconditionor", which quantifies the model's vulnerability to CDS by evaluating the mutual information between prediction residuals and their corresponding contexts. A high Reconditionor score indicates a severe susceptibility, thereby necessitating model adaptation. In this circumstance, we put forth a straightforward yet potent adapter framework for model calibration, termed the "sample-level contextualized adapter" or "SOLID". This framework involves the curation of a contextually similar dataset to the provided test sample and the subsequent fine-tuning of the model's prediction layer with a limited number of steps. Our theoretical analysis demonstrates that this adaptation strategy can achieve an optimal bias-variance trade-off. Notably, our proposed Reconditionor and SOLID are model-agnostic and readily adaptable to a wide range of models. Extensive experiments show that SOLID consistently enhances the performance of current forecasting models on real-world datasets, especially on cases with substantial CDS detected by the proposed Reconditionor, thus validating the effectiveness of the calibration approach.

Reversible Instance Normalization for Accurate Time-Series Forecasting against Distribution Shift

Addressing Distribution Shift in Time Series Forecasting with Instance Normalization Flows

Evolving Multi-Scale Normalization for Time Series Forecasting under Distribution Shifts

SIN: Selective and Interpretable Normalization for Long-Term Time Series Forecasting

Deep Imbalanced Time-series Forecasting via Local Discrepancy Density

Adaptive Normalization for Non-stationary Time Series Forecasting: A Temporal Slice Perspective

Frequency Adaptive Normalization For Non-stationary Time Series Forecasting

Deep Adaptive Input Normalization for Time Series Forecasting

DLinear photovoltaic power generation forecasting based on reversible instance normalization

REDI: Recurrent Diffusion Model for Probabilistic Time Series Forecasting

FredNormer: Frequency Domain Normalization for Non-stationary Time Series Forecasting

Self-normalization for Time Series: A Review of Recent Developments

Anomaly Detection in Time Series Data Using Reversible Instance Normalized Anomaly Transformer

Breaking Time Invariance: Assorted-Time Normalization for RNNs

Conditional normalization in time series analysis

Respecting Time Series Properties Makes Deep Time Series Forecasting Perfect

Calibration of Time-Series Forecasting: Detecting and Adapting Context-Driven Distribution Shift

AdaRNN: Adaptive Learning and Forecasting of Time Series

Simultaneously Reconciled Quantile Forecasting of Hierarchically Related Time Series

Learning Quantile Functions without Quantile Crossing for Distribution-free Time Series Forecasting

Robust Multi-Dimensional Time Series Forecasting