Abstract:One of the most challenging problems in the field of online learning is concept drift, which deeply influences the classification stability of streaming data. If the data stream is imbalanced, it is even more difficult to detect concept drifts and make an online learner adapt to them. Ensemble algorithms have been found effective for the classification of streaming data with concept drift, whereby an individual classifier is built for each incoming data chunk and its associated weight is adjusted to manage the drift. However, it is difficult to adjust the weights to achieve a balance between the stability and adaptability of the ensemble classifiers. In addition, when the data stream is imbalanced, the use of a size-fixed chunk to build a single classifier can create further problems; the data chunk may contain too few or even no minority class samples (i.e., only majority class samples). A classifier built on such a chunk is unstable in the ensemble. In this article, we propose a chunk-based incremental learning method called adaptive chunk-based dynamic weighted majority (ACDWM) to deal with imbalanced streaming data containing concept drift. ACDWM utilizes an ensemble framework by dynamically weighting the individual classifiers according to their classification performance on the current data chunk. The chunk size is adaptively selected by statistical hypothesis tests to access whether the classifier built on the current data chunk is sufficiently stable. ACDWM has four advantages compared with the existing methods as follows: 1) it can maintain stability when processing nondrifted streams and rapidly adapt to the new concept; 2) it is entirely incremental, i.e., no previous data need to be stored; 3) it stores a limited number of classifiers to ensure high efficiency; and 4) it adaptively selects the chunk size in the concept drift environment. Experiments on both synthetic and real data sets containing concept d-ift show that ACDWM outperforms both state-of-the-art chunk-based and online methods.

Weighted Ensemble with Dynamical Chunk Size for Imbalanced Data Streams in Nonstationary Environment

Adaptive Chunk-Based Dynamic Weighted Majority for Imbalanced Data Streams With Concept Drift

Incremental Learning Imbalanced Data Streams with Concept Drift: the Dynamic Updated Ensemble Algorithm

Incremental Weighted Ensemble for Data Streams With Concept Drift.

Online Ensemble Using Adaptive Windowing for Data Streams with Concept Drift

Dynamic Ensemble Selection for Imbalanced Data Streams with Concept Drift.

Active Learning With Drifted Data Streams Using Time-related Weight Classifier Ensemble Framework

Selection-based Resampling Ensemble Algorithm for Nonstationary Imbalanced Stream Data Learning

Dynamic Feature Weighting for Data Streams with Distribution-Based Log-Likelihood Divergence

A dynamic similarity weighted evolving fuzzy system for concept drift of data streams

Online Semi-Supervised Active Learning Ensemble Classification for Evolving Imbalanced Data Streams

A comprehensive ensemble classification techniques detecting and managing concept drift in dynamic imbalanced data streams

Mining Concept-Drifting and Noisy Data Streams Using Ensemble Classifiers

A Method for Classifying Data Stream Based on Reverse Classifier

Drift-detection Based Incremental Ensemble for Reacting to Different Kinds of Concept Drift

An Aggregate Ensemble for Mining Concept Drifting Data Streams with Noise

Active Fuzzy Weighting Ensemble for Dealing with Concept Drift

Online GBDT with Chunk Dynamic Weighted Majority Learners for Noisy and Drifting Data Streams

CDA-PDDWE: Concept Drift-Aware Performance-Based Diversified Dynamic Weighted Ensemble for Non-stationary Environments

Data Stream Concept Drift Detection Method Based on Mixture Ensemble Method

Classifying Imbalanced Data Streams via Dynamic Feature Group Weighting with Importance Sampling