Abstract:One of the most challenging problems in the field of online learning is concept drift, which deeply influences the classification stability of streaming data. If the data stream is imbalanced, it is even more difficult to detect concept drifts and make an online learner adapt to them. Ensemble algorithms have been found effective for the classification of streaming data with concept drift, whereby an individual classifier is built for each incoming data chunk and its associated weight is adjusted to manage the drift. However, it is difficult to adjust the weights to achieve a balance between the stability and adaptability of the ensemble classifiers. In addition, when the data stream is imbalanced, the use of a size-fixed chunk to build a single classifier can create further problems; the data chunk may contain too few or even no minority class samples (i.e., only majority class samples). A classifier built on such a chunk is unstable in the ensemble. In this article, we propose a chunk-based incremental learning method called adaptive chunk-based dynamic weighted majority (ACDWM) to deal with imbalanced streaming data containing concept drift. ACDWM utilizes an ensemble framework by dynamically weighting the individual classifiers according to their classification performance on the current data chunk. The chunk size is adaptively selected by statistical hypothesis tests to access whether the classifier built on the current data chunk is sufficiently stable. ACDWM has four advantages compared with the existing methods as follows: 1) it can maintain stability when processing nondrifted streams and rapidly adapt to the new concept; 2) it is entirely incremental, i.e., no previous data need to be stored; 3) it stores a limited number of classifiers to ensure high efficiency; and 4) it adaptively selects the chunk size in the concept drift environment. Experiments on both synthetic and real data sets containing concept d-ift show that ACDWM outperforms both state-of-the-art chunk-based and online methods.

Incremental Distributed Weighted Class Discriminant Analysis on Interval-Valued Emitter Parameters

Incremental Class Discriminant Analysis on Interval-Valued Emitter Signal Parameters

Incremental Discriminant Analysis on Interval-Valued Parameters for Emitter Identification

Discrimination of Three or More Partial Discharge Sources by Multi-Step Clustering of Cumulative Energy Features

Automatic Coefficient Selection in Weighted Maximum Margin Criterion

Sample Weighting: an Inherent Approach for Outlier Suppressing Discriminant Analysis

Incremental Hierarchical Clustering of Stochastic Pattern-Based Symbolic Data.

An Incremental Linear Discriminant Analysis Using Fixed Point Method

A Distributed Approach Toward Discriminative Distance Metric Learning

Reclaiming independence in spatial‐clustering datasets: A series of data‐driven spatial weights matrices

Transferable Intervalization and Midpoint De-Mixing Interval Independent Component Analysis for Industrial Fault Detection under Data Uncertainty

An Improved Generalized Discriminant Analysis for Large-Scale Data Set

Spectral Clustering for Discrete Distributions

Fine-Grained Attribute Weighted Inverted Specific-Class Distance Measure For Nominal Attributes

WIMMC: Weighted Incremental Maximum Margin Criterion

OPTIMIZED NEURAL INCREMENTAL ATTRIBUTE LEARNING FOR CLASSIFICATION BASED ON STATISTICAL DISCRIMINABILITY

Hierarchical Clustering of Complex Symbolic Data and Application for Emitter Identification

Anisotropic Diffusion Probabilistic Model for Imbalanced Image Classification

An interval AQI combination prediction model based on multiple data decomposition and information aggregation operator

Weighted Conditional Discriminant Analysis for Unseen Operating Modes Fault Diagnosis in Chemical Processes

Adaptive Chunk-Based Dynamic Weighted Majority for Imbalanced Data Streams With Concept Drift