Abstract:Time series forecasting (TSF) consists of point prediction and probabilistic forecasting. Unlike point forecasting which predicts an expected value of a future target, probabilistic time series forecasting models the uncertainty in data by predicting the distribution of future values, which enhances decision-making flexibility and improves risk management. Traditional probabilistic forecasting methods usually assume a fixed distribution of data, which is not always true for time series. Recently, there have been efforts to adapt diffusion models for time series owing to their exceptional ability to model the distribution of data without prior assumptions. However, how to apply advantages of diffusion models to time series forecasting remains a substantial challenge due to specific issues in time series such as distribution drift and complex dynamic temporal patterns. In this paper, we focus on the adaptation of diffusion models for time series forecasting. We propose REDI, a recurrent diffusion model that achieves effective probabilistic time series prediction with recurrent forward diffusion process and step-aware guidance in backward denoising process. The recurrent forward diffusion process enables the model to pay more attention to the impact of recent history on future values during the diffusion process, while the step-aware guidance facilitates precise guidance based on historical information during the denoising process. We conduct experiments on 5 real-world datasets and achieve average rankings of 1.8 for deterministic metrics and 1.5 for probabilistic metrics across 12 baselines, which strongly demonstrates the effectiveness of REDI.

Recentness Biased Learning for Time Series Forecasting

Learning to Learn the Future

A Hybrid Spiking Neurons Embedded LSTM Network for Multivariate Time Series Learning under Concept-Drift Environment

Online learning of ARIMA for time series prediction.(2016)

Effective LSTMs with Seasonal-Trend Decomposition and Adaptive Learning and Niching-Based Backtracking Search Algorithm for Time Series Forecasting

MemDA: Forecasting Urban Time Series with Memory-based Drift Adaptation

Enhancing Model Adaptability Using Concept Drift Detection for Short-Term Load Forecast

Learning Interpretable Deep State Space Model for Probabilistic Time Series Forecasting

Deep probabilistic time series forecasting using augmented recurrent input for dynamic systems

REDI: Recurrent Diffusion Model for Probabilistic Time Series Forecasting

Future-Guided Learning: A Predictive Approach To Enhance Time-Series Forecasting

Online Data Drift Detection for Anomaly Detection Services based on Deep Learning towards Multivariate Time Series

Real-time Drift Detection on Time-series Data

Optimizing Time-Series forecasting using stacked deep learning framework with enhanced adaptive moment estimation and error correction

Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecasting

Time series forecasting and anomaly detection using deep learning

Improved Predictive Deep Temporal Neural Networks with Trend Filtering

Proactive Model Adaptation Against Concept Drift for Online Time Series Forecasting

SCD-CA: Stable Concept Drift Learning Based on Correlation Alignment for Streaming Data Forecasting.

Autoregressive based Drift Detection Method

Enhanced Demand Forecasting: A Dynamic Iterative Regression Approach for Time Series Data