Abstract:In this paper, we find that existing online forecasting methods have the following issues: 1) They do not consider the update frequency of streaming data and directly use labels (future signals) to update the model, leading to information leakage. 2) Eliminating information leakage can exacerbate concept drift and online parameter updates can damage prediction accuracy. 3) Leaving out a validation set cuts off the model's continued learning. 4) Existing GPU devices cannot support online learning of large-scale streaming data. To address the above issues, we propose a novel online learning framework, Act-Now, to improve the online prediction on large-scale streaming data. Firstly, we introduce a Random Subgraph Sampling (RSS) algorithm designed to enable efficient model training. Then, we design a Fast Stream Buffer (FSB) and a Slow Stream Buffer (SSB) to update the model online. FSB updates the model immediately with the consistent pseudo- and partial labels to avoid information leakage. SSB updates the model in parallel using complete labels from earlier times. Further, to address concept drift, we propose a Label Decomposition model (Lade) with statistical and normalization flows. Lade forecasts both the statistical variations and the normalized future values of the data, integrating them through a combiner to produce the final predictions. Finally, we propose to perform online updates on the validation set to ensure the consistency of model learning on streaming data. Extensive experiments demonstrate that the proposed Act-Now framework performs well on large-scale streaming data, with an average 28.4% and 19.5% performance improvement, respectively. Experiments can be reproduced via <a class="link-external link-https" href="https://github.com/Anoise/Act-Now" rel="external noopener nofollow">this https URL</a>.

Online Distributional Regression

Online incremental regression for electricity price prediction

Online updating mode learning for streaming datasets

Scalable Estimation for Structured Additive Distributional Regression

Renewable estimation in expectile regression model with streaming data sets

Probabilistic Forecasting and Simulation of Electricity Markets via Online Dictionary Learning

Distributional Regression for Data Analysis

Online learning of ARIMA for time series prediction.(2016)

Lightweight Distributed Gaussian Process Regression for Online Machine Learning

Electronic structure study by means of X-ray spectroscopy and theoretical calculations of the "ferric star" single molecule magnet

Two-step online estimation and inference for expected shortfall regression with streaming data

Stagewise Boosting Distributional Regression

Online Ensemble Learning for Load Forecasting

MORStreaming: A Multioutput Regression System for Streaming Data

Inference on High-dimensional Single-index Models with Streaming Data

Multivariate Probabilistic CRPS Learning with an Application to Day-Ahead Electricity Prices

Adaptive debiased SGD in high-dimensional GLMs with streaming data

Postprocessing of point predictions for probabilistic forecasting of day-ahead electricity prices: The benefits of using isotonic distributional regression

Online Ensemble Approach for Probabilistic Wind Power Forecasting

Distribution Inference from Early-Stage Stationary Data Streams by Transfer Learning

Act Now: A Novel Online Forecasting Framework for Large-Scale Streaming Data