Abstract:Uncertain changes in data streams present challenges for machine learning models to dynamically adapt and uphold performance in real-time. Particularly, classification boundary change, also known as real concept drift, is the major cause of classification performance deterioration. However, accurately detecting real concept drift remains challenging because the theoretical foundations of existing drift detection methods - two-sample distribution tests and monitoring classification error rate, both suffer from inherent limitations such as the inability to distinguish virtual drift (changes not affecting the classification boundary, will introduce unnecessary model maintenance), limited statistical power, or high computational cost. Furthermore, no existing detection method can provide information on the trend of the drift, which could be invaluable for model maintenance. This work presents a novel real concept drift detection method based on Neighbor-Searching Discrepancy, a new statistic that measures the classification boundary difference between two samples. The proposed method is able to detect real concept drift with high accuracy while ignoring virtual drift. It can also indicate the direction of the classification boundary change by identifying the invasion or retreat of a certain class, which is also an indicator of separability change between classes. A comprehensive evaluation of 11 experiments is conducted, including empirical verification of the proposed theory using artificial datasets, and experimental comparisons with commonly used drift handling methods on real-world datasets. The results show that the proposed theory is robust against a range of distributions and dimensions, and the drift detection method outperforms state-of-the-art alternative methods.

LCDD: Detecting Business Process Drifts Based on Local Completeness

Detecting Process Concept Drifts from Event Logs.

Detecting sudden and gradual drifts in business processes from execution traces

CPL+: An improved approach for evaluating the local completeness of event logs

Process Drift Detection in Event Logs with Graph Convolutional Networks.

Detecting Drift from Event Streams of Unpredictable Business Processes.

An Approach to Evaluate the Local Completeness of an Event Log

A Survey on Concept Drift in Process Mining

Detecting and Responding to Concept Drift in Business Processes

Dynamic Mutual Information Similarity Based Transient Process Identification and Fault Detection

An Approach for Mining Multiple Types of Silent Transitions in Business Process

An End-to-End Approach for Online Decision Mining and Decision Drift Analysis in Process-Aware Information Systems: Extended Version

Detecting and Explaining Drifts in Yearly Grant Applications

A fault detection method based on DLPP for dynamic processes

Quality-Relevant Process Monitoring with Concurrent Locality-Preserving Dynamic Latent Variable Method

Grouping Local Process Models

A Neighbor-Searching Discrepancy-based Drift Detection Scheme for Learning Evolving Data

Detecting implicit dependencies between tasks from event logs

Efficient Syntactic Process Difference Detection Using Flexible Feature Matching.

Detecting and rationalizing concept drift: A feature-level approach for understanding cause–effect relationships in dynamic environments

Are Concept Drift Detectors Reliable Alarming Systems? -- A Comparative Study