Abstract:Uncertain changes in data streams present challenges for machine learning models to dynamically adapt and uphold performance in real-time. Particularly, classification boundary change, also known as real concept drift, is the major cause of classification performance deterioration. However, accurately detecting real concept drift remains challenging because the theoretical foundations of existing drift detection methods - two-sample distribution tests and monitoring classification error rate, both suffer from inherent limitations such as the inability to distinguish virtual drift (changes not affecting the classification boundary, will introduce unnecessary model maintenance), limited statistical power, or high computational cost. Furthermore, no existing detection method can provide information on the trend of the drift, which could be invaluable for model maintenance. This work presents a novel real concept drift detection method based on Neighbor-Searching Discrepancy, a new statistic that measures the classification boundary difference between two samples. The proposed method is able to detect real concept drift with high accuracy while ignoring virtual drift. It can also indicate the direction of the classification boundary change by identifying the invasion or retreat of a certain class, which is also an indicator of separability change between classes. A comprehensive evaluation of 11 experiments is conducted, including empirical verification of the proposed theory using artificial datasets, and experimental comparisons with commonly used drift handling methods on real-world datasets. The results show that the proposed theory is robust against a range of distributions and dimensions, and the drift detection method outperforms state-of-the-art alternative methods.

Robust and Rapid Adaption for Concept Drift in Software System Anomaly Detection.

Interactive Context-Aware Anomaly Detection Guided by User Feedback

CD-SR: A Real-time Anomaly Detection Framework for Continuous Concept Drift

ADTCD: An Adaptive Anomaly Detection Approach Toward Concept Drift in IoT

METER: A Dynamic Concept Adaptation Framework for Online Anomaly Detection

Confidence Guided Anomaly Detection Model for Anti-Concept Drift in Dynamic Logs

Learn to Adapt: Robust Drift Detection in Security Domain

Anomaly Detection over Concept Drifting Data Streams

Anomaly and change point detection for time series with concept drift

Anomaly Detection and Concept Drift Adaptation for Dynamic Systems: A General Method with Practical Implementation Using an Industrial Collaborative Robot

Learning with Drift Detection Based on K Time Sub-concept Windows

Drift-aware Anomaly Detection for Non-stationary Time Series

Are Concept Drift Detectors Reliable Alarming Systems? -- A Comparative Study

Rapid Deployment of Anomaly Detection Models for Large Number of Emerging KPI Streams.

A Multiscale Concept Drift Detection Method for Learning from Data Streams

A Neighbor-Searching Discrepancy-based Drift Detection Scheme for Learning Evolving Data

Online Drift Detection with Maximum Concept Discrepancy

Addressing Concept Shift in Online Time Series Forecasting: Detect-then-Adapt

Detecting and rationalizing concept drift: A feature-level approach for understanding cause–effect relationships in dynamic environments

Multiscale Drift Detection Test to Enable Fast Learning in Nonstationary Environments

A Framework for Adaptive Anomaly Detection Based on Support Vector Data Description