Abstract:Classifiers deployed in the real world operate in a dynamic environment, where the data distribution can change over time. These changes, referred to as concept drift, can cause the predictive performance of the classifier to drop over time, thereby making it obsolete. To be of any real use, these classifiers need to detect drifts and be able to adapt to them, over time. Detecting drifts has traditionally been approached as a supervised task, with labeled data constantly being used for validating the learned model. Although effective in detecting drifts, these techniques are impractical, as labeling is a difficult, costly and time consuming activity. On the other hand, unsupervised change detection techniques are unreliable, as they produce a large number of false alarms. The inefficacy of the unsupervised techniques stems from the exclusion of the characteristics of the learned classifier, from the detection process. In this paper, we propose the Margin Density Drift Detection (MD3) algorithm, which tracks the number of samples in the uncertainty region of a classifier, as a metric to detect drift. The MD3 algorithm is a distribution independent, application independent, model independent, unsupervised and incremental algorithm for reliably detecting drifts from data streams. Experimental evaluation on 6 drift induced datasets and 4 additional datasets from the cybersecurity domain demonstrates that the MD3 approach can reliably detect drifts, with significantly fewer false alarms compared to unsupervised feature based drift detectors. The reduced false alarms enables the signaling of drifts only when they are most likely to affect classification performance. As such, the MD3 approach leads to a detection scheme which is credible, label efficient and general in its applicability.

CD-SR: A Real-time Anomaly Detection Framework for Continuous Concept Drift

Robust and Rapid Adaption for Concept Drift in Software System Anomaly Detection.

ADTCD: An Adaptive Anomaly Detection Approach Toward Concept Drift in IoT

A Neighbor-Searching Discrepancy-based Drift Detection Scheme for Learning Evolving Data

Interactive Context-Aware Anomaly Detection Guided by User Feedback

Enhancing Model Adaptability Using Concept Drift Detection for Short-Term Load Forecast

Learning with Drift Detection Based on K Time Sub-concept Windows

Time to Retrain? Detecting Concept Drifts in Machine Learning Systems

Are Concept Drift Detectors Reliable Alarming Systems? -- A Comparative Study

Drift Doesn't Matter: Dynamic Decomposition with Diffusion Reconstruction for Unstable Multivariate Time Series Anomaly Detection.

A Multiscale Concept Drift Detection Method for Learning from Data Streams

Multiscale Drift Detection Test to Enable Fast Learning in Nonstationary Environments

ReCDA: Concept Drift Adaptation with Representation Enhancement for Network Intrusion Detection

Subspace Detection on Concept Drifting Data Stream

Class Distribution Monitoring for Concept Drift Detection

Anomaly Detection over Concept Drifting Data Streams

Concept Drift Detection Based on Typicality and Eccentricity

METER: A Dynamic Concept Adaptation Framework for Online Anomaly Detection

Concept Drift Detection Delay Index

LSTMDD: an optimized LSTM-based drift detector for concept drift in dynamic cloud computing

On the Reliable Detection of Concept Drift from Streaming Unlabeled Data