Abstract:Beyond applying machine learning predictive models to static tasks, a significant corpus of research exists that applies machine learning predictive models to streaming environments that incur concept drift. With the prevalence of streaming real-world applications that are associated with changes in the underlying data distribution, the need for applications that are capable of adapting to evolving and time-varying dynamic environments can be hardly overstated. Dynamic environments are nonstationary and change with time and the target variables to be predicted by the learning algorithm and often evolve with time, a phenomenon known as concept drift. Most work in handling concept drift focuses on updating the prediction model so that it can recover from concept drift while little effort has been dedicated to the formulation of a learning system that is capable of learning different types of drifting concepts at any time with minimum overheads. This work proposes a novel and evolving data stream classifier called Adaptive Diversified Ensemble Selection Classifier (ADES) that significantly optimizes adaptation to different types of concept drifts at any time and improves convergence to new concepts by exploiting different amounts of ensemble diversity. The ADES algorithm generates diverse base classifiers, thereby optimizing the margin distribution to exploit ensemble diversity to formulate an ensemble classifier that generalizes well to unseen instances and provides fast recovery from different types of concept drift. Empirical experiments conducted on both artificial and real-world data streams demonstrate that ADES can adapt to different types of drifts at any given time. The prediction performance of ADES is compared to three other ensemble classifiers designed to handle concept drift using both artificial and real-world data streams. The comparative evaluation performed demonstrated the ability of ADES to handle different types of concept drifts. The experimental results, including statistical test results, indicate comparable performances with other algorithms designed to handle concept drift and prove their significance and effectiveness.

Dynamic Ensemble Selection for Imbalanced Data Streams with Concept Drift.

The Gradual Resampling Ensemble for Mining Imbalanced Data Streams with Concept Drift

Incremental Learning Imbalanced Data Streams with Concept Drift: the Dynamic Updated Ensemble Algorithm

Imbalanced Data Stream Classification using Dynamic Ensemble Selection

Selection-based Resampling Ensemble Algorithm for Nonstationary Imbalanced Stream Data Learning

Online Semi-Supervised Active Learning Ensemble Classification for Evolving Imbalanced Data Streams

Incremental Weighted Ensemble for Data Streams With Concept Drift.

A comprehensive ensemble classification techniques detecting and managing concept drift in dynamic imbalanced data streams

Adaptive Chunk-Based Dynamic Weighted Majority for Imbalanced Data Streams With Concept Drift

Pro-IDD: Pareto-based Ensemble for Imbalanced and Drifting Data Streams

CDA-PDDWE: Concept Drift-Aware Performance-Based Diversified Dynamic Weighted Ensemble for Non-stationary Environments

Weighted Ensemble with Dynamical Chunk Size for Imbalanced Data Streams in Nonstationary Environment

ADES: A New Ensemble Diversity-Based Approach for Handling Concept Drift

Learning Concept-Drifting Data Streams with Random Ensemble Decision Trees

Selected Ensemble of Classifiers for Handling Concept-drifting Data Streams

Online Ensemble Using Adaptive Windowing for Data Streams with Concept Drift

A Better Algorithm for Classifying Data Streams with Concept Drifting

An Ensemble Classifier Algorithm for Mining Data Streams Based on Concept Drift

Random Ensemble Decision Trees for Learning Concept-Drifting Data Streams.

A Selectively Re-train Approach Based on Clustering to Classify Concept-Drifting Data Streams with Skewed Distribution

Drift-detection Based Incremental Ensemble for Reacting to Different Kinds of Concept Drift