Abstract:One of the most challenging problems in the field of online learning is concept drift, which deeply influences the classification stability of streaming data. If the data stream is imbalanced, it is even more difficult to detect concept drifts and make an online learner adapt to them. Ensemble algorithms have been found effective for the classification of streaming data with concept drift, whereby an individual classifier is built for each incoming data chunk and its associated weight is adjusted to manage the drift. However, it is difficult to adjust the weights to achieve a balance between the stability and adaptability of the ensemble classifiers. In addition, when the data stream is imbalanced, the use of a size-fixed chunk to build a single classifier can create further problems; the data chunk may contain too few or even no minority class samples (i.e., only majority class samples). A classifier built on such a chunk is unstable in the ensemble. In this article, we propose a chunk-based incremental learning method called adaptive chunk-based dynamic weighted majority (ACDWM) to deal with imbalanced streaming data containing concept drift. ACDWM utilizes an ensemble framework by dynamically weighting the individual classifiers according to their classification performance on the current data chunk. The chunk size is adaptively selected by statistical hypothesis tests to access whether the classifier built on the current data chunk is sufficiently stable. ACDWM has four advantages compared with the existing methods as follows: 1) it can maintain stability when processing nondrifted streams and rapidly adapt to the new concept; 2) it is entirely incremental, i.e., no previous data need to be stored; 3) it stores a limited number of classifiers to ensure high efficiency; and 4) it adaptively selects the chunk size in the concept drift environment. Experiments on both synthetic and real data sets containing concept d-ift show that ACDWM outperforms both state-of-the-art chunk-based and online methods.

StreamDFP: A General Stream Mining Framework for Adaptive Disk Failure Prediction

Toward Adaptive Disk Failure Prediction Via Stream Mining

A Failure Prediction Approach Based on BiLSTM and Deep Feature Extractor for Hard Disk Drives.

TS-DM: A Time Segmentation-Based Data Stream Learning Method for Concept Drift Adaptation

Disk failure prediction based on multi-layer domain adaptive learning

DDG-DA: Data Distribution Generation for Predictable Concept Drift Adaptation

A new predictive method supporting streaming data with hybrid recurring concept drifts in process industry

Mining Noisy Data Streams Via A Discriminative Model

An Adaptive Learning Approach for Noisy Data Streams

A reliable adaptive prototype-based learning for evolving data streams with limited labels

On the Performance and Convergence of Distributed Stream Processing Via Approximate Fault Tolerance

Building a Fault Tolerant Framework with Deadline Guarantee in Big Data Stream Computing Environments.

SCD-CA: Stable Concept Drift Learning Based on Correlation Alignment for Streaming Data Forecasting.

Enabling Low-Redundancy Proactive Fault Tolerance for Stream Machine Learning Via Erasure Coding

Predictive Queries Algorithm Based on Probability Model over Data Streams

Online Active Learning for Drifting Data Streams

Data-driven decision support under concept drift in streamed big data

Evolving Large-Scale Data Stream Analytics based on Scalable PANFIS

Act Now: A Novel Online Forecasting Framework for Large-Scale Streaming Data

Adaptive Chunk-Based Dynamic Weighted Majority for Imbalanced Data Streams With Concept Drift

An Ensemble Classifier Algorithm for Mining Data Streams Based on Concept Drift