Abstract:Data stream research has grown rapidly over the last decade. Two major features distinguish data stream from batch learning: stream data are generated on the fly, possibly in a fast and variable rate; and the underlying data distribution can be non-stationary, leading to a phenomenon known as concept drift. Therefore, most of the research on data stream classification focuses on proposing efficient models that can adapt to concept drifts and maintain a stable performance over time. However, specifically for the classification task, the majority of such methods rely on the instantaneous availability of true labels for all already classified instances. This is a strong assumption that is rarely fulfilled in practical applications. Hence there is a clear need for efficient methods that can detect concept drifts in an unsupervised way. One possibility is the well-known Kolmogorov-Smirnov test, a statistical hypothesis test that checks whether two samples differ. This work has two main contributions. The first one is the Incremental Kolmogorov-Smirnov algorithm that allows performing the Kolmogorov-Smirnov hypothesis test instantly using two samples that change over time, where the change is an insertion and/or removal of an observation. Our algorithm employs a randomized tree and is able to perform the insertion and removal operations in O(log N) with high probability and calculate the Kolmogorov-Smirnov test in O(1), where N is the number of sample observations. This is a significant speed-up compared to the O(N log N) cost of the non-incremental implementation. The second contribution is the use of the Incremental Kolmogorov-Smirnov test to detect concept drifts without true labels. Classification algorithms adapted to use the test rely on a limited portion of those labels just to update the classification model after a concept drift is detected.

Detecting Drift from Event Streams of Unpredictable Business Processes.

Detecting sudden and gradual drifts in business processes from execution traces

Visual Drift Detection for Sequence Data Analysis of Business Processes

Detecting Process Concept Drifts from Event Logs.

Process Drift Detection in Event Logs with Graph Convolutional Networks.

Detecting and Explaining Drifts in Yearly Grant Applications

LCDD: Detecting Business Process Drifts Based on Local Completeness

An Empirical Study of Uncertainty Estimation Techniques for Detecting Drift in Data Streams

Identifying Predictions That Influence the Future: Detecting Performative Concept Drift in Data Streams

An End-to-End Approach for Online Decision Mining and Decision Drift Analysis in Process-Aware Information Systems: Extended Version

Driftage: a multi-agent system framework for concept drift detection

Unraveling Process Evolution by Handling Concept Drifts in Process Mining

Diagnosing Concept Drift in Streaming Data

A Survey on Concept Drift in Process Mining

A Multiscale Concept Drift Detection Method for Learning from Data Streams

One or Two Things We know about Concept Drift -- A Survey on Monitoring Evolving Environments

Unveiling dynamics changes: Singular spectrum analysis-based method for detecting concept drift in industrial data streams

Methods for Generating Drift in Text Streams

Diagnosing Concept Drift with Visual Analytics

FBDD: feature-based drift detector for batch processing data

Fast Unsupervised Online Drift Detection Using Incremental Kolmogorov-Smirnov Test