Abstract:Data stream research has grown rapidly over the last decade. Two major features distinguish data stream from batch learning: stream data are generated on the fly, possibly in a fast and variable rate; and the underlying data distribution can be non-stationary, leading to a phenomenon known as concept drift. Therefore, most of the research on data stream classification focuses on proposing efficient models that can adapt to concept drifts and maintain a stable performance over time. However, specifically for the classification task, the majority of such methods rely on the instantaneous availability of true labels for all already classified instances. This is a strong assumption that is rarely fulfilled in practical applications. Hence there is a clear need for efficient methods that can detect concept drifts in an unsupervised way. One possibility is the well-known Kolmogorov-Smirnov test, a statistical hypothesis test that checks whether two samples differ. This work has two main contributions. The first one is the Incremental Kolmogorov-Smirnov algorithm that allows performing the Kolmogorov-Smirnov hypothesis test instantly using two samples that change over time, where the change is an insertion and/or removal of an observation. Our algorithm employs a randomized tree and is able to perform the insertion and removal operations in O(log N) with high probability and calculate the Kolmogorov-Smirnov test in O(1), where N is the number of sample observations. This is a significant speed-up compared to the O(N log N) cost of the non-incremental implementation. The second contribution is the use of the Incremental Kolmogorov-Smirnov test to detect concept drifts without true labels. Classification algorithms adapted to use the test rely on a limited portion of those labels just to update the classification model after a concept drift is detected.

OSNN: An Online Semisupervised Neural Network for Nonstationary Data Streams

Online Reliable Semi-supervised Learning on Evolving Data Streams

Online Self-Learning Stochastic Configuration Networks for Nonstationary Data Stream Analysis

SACCOS: A Semi-Supervised Framework for Emerging Class Detection and Concept Drift Adaption Over Data Streams

Deep Stacked Stochastic Configuration Networks for Lifelong Learning of Non-Stationary Data Streams.

Evaluating k-NN in the Classification of Data Streams with Concept Drift

Semi-Supervised Streaming Learning with Emerging New Labels

Online Semi-Supervised Classification on Multilabel Evolving High-Dimensional Text Streams

Deep CovDenseSNN: A Hierarchical Event-Driven Dynamic Framework with Spiking Neurons in Noisy Environment

Advances on Concept Drift Detection in Regression Tasks using Social Networks Theory

Self-Organizing Recurrent Stochastic Configuration Networks for Nonstationary Data Modelling

Learning High-Dimensional Evolving Data Streams with Limited Labels

Online Boosting Adaptive Learning under Concept Drift for Multistream Classification

Anomaly Detection over Concept Drifting Data Streams

Learning from Concept Drifting Data Streams with Unlabeled Data

Concept Drift Detection and Adaptation with Weak Supervision on Streaming Unlabeled Data

Fast Unsupervised Online Drift Detection Using Incremental Kolmogorov-Smirnov Test

Difficult Novel Class Detection in Semisupervised Streaming Data

An ensemble learning method with GAN-based sampling and consistency check for anomaly detection of imbalanced data streams with concept drift

A fast online stacked regressor to handle concept drifts

Unsupervised anomaly detection in multivariate time series with online evolving spiking neural networks