Abstract:Uncertain changes in data streams present challenges for machine learning models to dynamically adapt and uphold performance in real-time. Particularly, classification boundary change, also known as real concept drift, is the major cause of classification performance deterioration. However, accurately detecting real concept drift remains challenging because the theoretical foundations of existing drift detection methods - two-sample distribution tests and monitoring classification error rate, both suffer from inherent limitations such as the inability to distinguish virtual drift (changes not affecting the classification boundary, will introduce unnecessary model maintenance), limited statistical power, or high computational cost. Furthermore, no existing detection method can provide information on the trend of the drift, which could be invaluable for model maintenance. This work presents a novel real concept drift detection method based on Neighbor-Searching Discrepancy, a new statistic that measures the classification boundary difference between two samples. The proposed method is able to detect real concept drift with high accuracy while ignoring virtual drift. It can also indicate the direction of the classification boundary change by identifying the invasion or retreat of a certain class, which is also an indicator of separability change between classes. A comprehensive evaluation of 11 experiments is conducted, including empirical verification of the proposed theory using artificial datasets, and experimental comparisons with commonly used drift handling methods on real-world datasets. The results show that the proposed theory is robust against a range of distributions and dimensions, and the drift detection method outperforms state-of-the-art alternative methods.

A MODIFIED LEARN++.NSE ALGORITHM FOR DEALING WITH CONCEPT DRIFT

Active Fuzzy Weighting Ensemble for Dealing with Concept Drift

A Better Algorithm for Classifying Data Streams with Concept Drifting

Effects of Different Base Classifiers to Learn++ Family Algorithms for Concept Drifting and Imbalanced Pattern Classification Problems

Concept Drift Adaptation with Continuous Kernel Learning

Enhancing Model Adaptability Using Concept Drift Detection for Short-Term Load Forecast

Knowledge-maximized Ensemble Algorithm for Different Types of Concept Drift

Drift-detection Based Incremental Ensemble for Reacting to Different Kinds of Concept Drift

A Neighbor-Searching Discrepancy-based Drift Detection Scheme for Learning Evolving Data

Using diversity to handle concept drift in on-line learning

Automatic Learning to Detect Concept Drift

DDD: A New Ensemble Approach for Dealing with Concept Drift

DriftSurf: A Risk-competitive Learning Algorithm under Concept Drift

Learning with Drift Detection Based on K Time Sub-concept Windows

Learning Evolving Concepts with Online Class Posterior Probability

Learning under Concept Drift: A Review

CDA-PDDWE: Concept Drift-Aware Performance-Based Diversified Dynamic Weighted Ensemble for Non-stationary Environments

Tracking Concept Drifting with an Online-Optimized Incremental Learning Framework

A Drift Region-Based Data Sample Filtering Method

An Accuracy-and-Diversity-based Ensemble Method for Concept Drift and Its Application in Fraud Detection

Recurring Concept Meta-learning for Evolving Data Streams