Abstract:Uncertain changes in data streams present challenges for machine learning models to dynamically adapt and uphold performance in real-time. Particularly, classification boundary change, also known as real concept drift, is the major cause of classification performance deterioration. However, accurately detecting real concept drift remains challenging because the theoretical foundations of existing drift detection methods - two-sample distribution tests and monitoring classification error rate, both suffer from inherent limitations such as the inability to distinguish virtual drift (changes not affecting the classification boundary, will introduce unnecessary model maintenance), limited statistical power, or high computational cost. Furthermore, no existing detection method can provide information on the trend of the drift, which could be invaluable for model maintenance. This work presents a novel real concept drift detection method based on Neighbor-Searching Discrepancy, a new statistic that measures the classification boundary difference between two samples. The proposed method is able to detect real concept drift with high accuracy while ignoring virtual drift. It can also indicate the direction of the classification boundary change by identifying the invasion or retreat of a certain class, which is also an indicator of separability change between classes. A comprehensive evaluation of 11 experiments is conducted, including empirical verification of the proposed theory using artificial datasets, and experimental comparisons with commonly used drift handling methods on real-world datasets. The results show that the proposed theory is robust against a range of distributions and dimensions, and the drift detection method outperforms state-of-the-art alternative methods.

A Concept Drift Detection Algorithm for Power Data Stream

A Better Algorithm for Classifying Data Streams with Concept Drifting

A Method for Classifying Data Stream Based on Reverse Classifier

A Classification and Novel Class Detection Algorithm for Concept Drift Data Stream Based on the Cohesiveness and Separation Index of Mahalanobis Distance

A Neighbor-Searching Discrepancy-based Drift Detection Scheme for Learning Evolving Data

An Improving Fuzzy C-means Algorithm for Concept-Drifting Data Stream

A Concept Drift Detection Algorithm Based On Fuzzy Marginal Density

Model updating mechanism of concept drift detection in data stream based on classifier pool

Data Stream Concept Drift Detection Method Based on Mixture Ensemble Method

Concept Drift Detection Delay Index

High-Dimensional Multi-Label Data Stream Classification with Concept Drifting Detection

Drift Detection for Multi-label Data Streams Based on Label Grouping and Entropy

Detecting Concept Drift: an Information Entropy Based Method Using an Adaptive Sliding Window

Data Stream Classification with Data Uncertainty and Concept Drift

Adaptive Ensemble Classification Algorithm for Data Streams Based on Information Entropy

An Ensemble Classifier Algorithm for Mining Data Streams Based on Concept Drift

Addressing Concept-Evolution in Concept-Drifting Data Streams

A Double-Window-Based Classification Algorithm for Concept Drifting Data Streams

Concept Drift Detection Method for Multidimensional Data Stream Based on Clustering Partition

A Multiscale Concept Drift Detection Method for Learning from Data Streams

Three-layer Concept Drifting Detection in Text Data Streams