Abstract:Uncertain changes in data streams present challenges for machine learning models to dynamically adapt and uphold performance in real-time. Particularly, classification boundary change, also known as real concept drift, is the major cause of classification performance deterioration. However, accurately detecting real concept drift remains challenging because the theoretical foundations of existing drift detection methods - two-sample distribution tests and monitoring classification error rate, both suffer from inherent limitations such as the inability to distinguish virtual drift (changes not affecting the classification boundary, will introduce unnecessary model maintenance), limited statistical power, or high computational cost. Furthermore, no existing detection method can provide information on the trend of the drift, which could be invaluable for model maintenance. This work presents a novel real concept drift detection method based on Neighbor-Searching Discrepancy, a new statistic that measures the classification boundary difference between two samples. The proposed method is able to detect real concept drift with high accuracy while ignoring virtual drift. It can also indicate the direction of the classification boundary change by identifying the invasion or retreat of a certain class, which is also an indicator of separability change between classes. A comprehensive evaluation of 11 experiments is conducted, including empirical verification of the proposed theory using artificial datasets, and experimental comparisons with commonly used drift handling methods on real-world datasets. The results show that the proposed theory is robust against a range of distributions and dimensions, and the drift detection method outperforms state-of-the-art alternative methods.

Multi-window Drift Detection Method Based on Integrating Outlier Identification and Input/Output Space Information with Its Application

The Application of a Double CUSUM Algorithm in Industrial Data Stream Anomaly Detection

Monitoring Method Based on Multivariate Statistical Signal Processing for Batch Process

Spatio‐temporal Adaptive Soft Sensor for Nonlinear Time‐varying and Variable Drifting Processes Based on Moving Window LWPLS and Time Difference Model

A Drift Detection Method for Industrial Images Based on a Defect Segmentation Model

Multiscale Drift Detection Test to Enable Fast Learning in Nonstationary Environments

Online Updating Soft Sensor Modeling and Industrial Application Based on Selectively Integrated Moving Window Approach

Unveiling dynamics changes: Singular spectrum analysis-based method for detecting concept drift in industrial data streams

Adaptive soft sensor based on time difference model and locally weighted partial least squares regression

Learning with Drift Detection Based on K Time Sub-concept Windows

nti-drift in E-nose : A subspace projection approach with drift eduction

A Multiscale Concept Drift Detection Method for Learning from Data Streams

Adaptive Soft Sensor Modeling Based on Weighted Supervised Latent Factor Analysis with Selectively Integrated Moving Windows

Anti-Drift in Electronic Nose via Dimensionality Reduction: A Discriminative Subspace Projection Approach

A Double-Window-Based Classification Algorithm for Concept Drifting Data Streams

Anti-drift in E-nose: A Subspace Projection Approach with Drift Reduction

A Neighbor-Searching Discrepancy-based Drift Detection Scheme for Learning Evolving Data

Concept drift detection for data stream learning based on angle optimized global embedding and principal component analysis in sensor networks.

Concept Drift Region Identification Via Competence-Based Discrepancy Distribution Estimation

Unsupervised Concept Drift Detection for Time Series on Riemannian Manifolds

Hierarchical Reduced-space Drift Detection Framework for Multivariate Supervised Data Streams