Abstract:In many real-world applications, continuous machine learning (ML) systems are crucial but prone to data drift, a phenomenon where discrepancies between historical training data and future test data lead to significant performance degradation and operational inefficiencies. Traditional drift adaptation methods typically update models using ensemble techniques, often discarding drifted historical data, and focus primarily on either covariate drift or concept drift. These methods face issues such as high resource demands, inability to manage all types of drifts effectively, and neglecting the valuable context that historical data can provide. We contend that explicitly incorporating drifted data into the model training process significantly enhances model accuracy and robustness. This paper introduces an advanced framework that integrates the strengths of data-centric approaches with adaptive management of both covariate and concept drift in a scalable and efficient manner. Our framework employs sophisticated data segmentation techniques to identify optimal data batches that accurately reflect test data patterns. These data batches are then utilized for training on test data, ensuring that the models remain relevant and accurate over time. By leveraging the advantages of both data segmentation and scalable drift management, our solution ensures robust model accuracy and operational efficiency in large-scale ML deployments. It also minimizes resource consumption and computational overhead by selecting and utilizing relevant data subsets, leading to significant cost savings. Experimental results on classification task on real-world and synthetic datasets show our approach improves model accuracy while reducing operational costs and latency. This practical solution overcomes inefficiencies in current methods, providing a robust, adaptable, and scalable approach.

Enhancing Model Adaptability Using Concept Drift Detection for Short-Term Load Forecast

Addressing Concept Shift in Online Time Series Forecasting: Detect-then-Adapt

Adaptive Short-Term Wind Power Forecasting with Concept Drifts

Recent Advances in Concept Drift Adaptation Methods for Deep Learning.

Proactive Model Adaptation Against Concept Drift for Online Time Series Forecasting

DDG-DA: Data Distribution Generation for Predictable Concept Drift Adaptation

Random Forest Based Approach for Concept Drift Handling

Handling Concept Drift in Global Time Series Forecasting

A Stacking Framework for Online Locational Marginal Price Prediction Considering Concept Drift

Concept Drift Adaptation with Scarce Labels

Concept Drift Adaptation by Exploiting Drift Type

Concept Drift Adaptation with Continuous Kernel Learning

A Scalable Approach to Covariate and Concept Drift Management via Adaptive Data Segmentation

Concept Drift Adaptation with Scarce Labels: A Novel Approach Based on Diffusion and Adversarial Learning

Concept Drift Adaptation for CTR Prediction in Online Advertising Systems

METER: A Dynamic Concept Adaptation Framework for Online Anomaly Detection

MemDA: Forecasting Urban Time Series with Memory-based Drift Adaptation

ADTCD: An Adaptive Anomaly Detection Approach Toward Concept Drift in IoT

Online Drift Detection with Maximum Concept Discrepancy

SCD-CA: Stable Concept Drift Learning Based on Correlation Alignment for Streaming Data Forecasting.