Abstract:As data streams are gaining prominence in a growing number of emerging application domains, classification on data streams is becoming an active research area. Currently, the typical approach to this problem is based on ensemble learning, which learns basic classifiers from training data stream and forms the global predictor by organizing these basic ones. While this approach seems successful to some extent, its performance usually suffers from two contradictory elements existing naturally within many application scenarios: firstly, the need for gathering sufficient training data for basic classifiers and engaging enough basic learners in voting for bias-variance reduction; and secondly, the requirement for significant sensitivity to concept-drifts, which places emphasis on using recent training data and up-to-date individual classifiers. It results in such a dilemma that some algorithms are not sensitive enough to concept-drifts while others, although sensitive enough, suffer from unsatisfactory classification accuracy. In this paper, we propose an ensemble learning algorithm, which: (1) furnishes training data for basic classifiers, starting from the up-to-date data chunk and searching for complement from past chunks while ruling out the data inconsistent with current concept; (2) provides effective voting by adaptively distinguishing sensible classifiers from the else and engaging sensible ones as voters. Experimental results justify the superiority of this strategy in terms of both accuracy and sensitivity, especially in severe circumstances where training data is extremely insufficient or concepts are evolving frequently and significantly.

An ensemble-based online learning algorithm for streaming data

A new online learning algorithm for streaming data and decision support with a Bayesian approach

An Automatic Construction and Organization Strategy for Ensemble Learning on Data Streams

Online ensemble learning algorithm for imbalanced data stream

Streaming Active Deep Forest for Evolving Data Stream Classification

Multi-Window Based Ensemble Learning for Classification of Imbalanced Streaming Data

A Framework of Online Learning with Imbalanced Streaming Data.

Online Learning from Capricious Data Streams: A Generative Approach.

BatchEnsemble: An Alternative Approach to Efficient Ensemble and Lifelong Learning

Lifelong Machine Learning with Deep Streaming Linear Discriminant Analysis

Online learning for streaming data classification in nonstationary environments

Incremental Learning Imbalanced Data Streams with Concept Drift: the Dynamic Updated Ensemble Algorithm

Implicit Context-aware Learning and Discovery for Streaming Data Analytics

Learning Concept-Drifting Data Streams with Random Ensemble Decision Trees

Learning with Feature Evolvable Streams.

Adaptive regularized ensemble for evolving data stream classification

Rarity updated ensemble with oversampling: An ensemble approach to classification of imbalanced data streams

STREAMLINE: Streaming Active Learning for Realistic Multi-Distributional Settings

Discovering an Evolutionary Classifier over a High-speed Nonstatic Stream

Streaming Active Learning with Deep Neural Networks

Learning High-Dimensional Evolving Data Streams with Limited Labels