Abstract:One of the most challenging problems in the field of online learning is concept drift, which deeply influences the classification stability of streaming data. If the data stream is imbalanced, it is even more difficult to detect concept drifts and make an online learner adapt to them. Ensemble algorithms have been found effective for the classification of streaming data with concept drift, whereby an individual classifier is built for each incoming data chunk and its associated weight is adjusted to manage the drift. However, it is difficult to adjust the weights to achieve a balance between the stability and adaptability of the ensemble classifiers. In addition, when the data stream is imbalanced, the use of a size-fixed chunk to build a single classifier can create further problems; the data chunk may contain too few or even no minority class samples (i.e., only majority class samples). A classifier built on such a chunk is unstable in the ensemble. In this article, we propose a chunk-based incremental learning method called adaptive chunk-based dynamic weighted majority (ACDWM) to deal with imbalanced streaming data containing concept drift. ACDWM utilizes an ensemble framework by dynamically weighting the individual classifiers according to their classification performance on the current data chunk. The chunk size is adaptively selected by statistical hypothesis tests to access whether the classifier built on the current data chunk is sufficiently stable. ACDWM has four advantages compared with the existing methods as follows: 1) it can maintain stability when processing nondrifted streams and rapidly adapt to the new concept; 2) it is entirely incremental, i.e., no previous data need to be stored; 3) it stores a limited number of classifiers to ensure high efficiency; and 4) it adaptively selects the chunk size in the concept drift environment. Experiments on both synthetic and real data sets containing concept d-ift show that ACDWM outperforms both state-of-the-art chunk-based and online methods.

Efficient Non-stationary Online Learning by Wavelets with Applications to Online Distribution Shift Adaptation

Efficient Methods for Non-stationary Online Learning

Adaptivity and Non-stationarity: Problem-dependent Dynamic Regret for Online Convex Optimization

Nonstationary Nonparametric Online Learning: Balancing Dynamic Regret and Model Parsimony

Adapting to Online Label Shift with Provable Guarantees

Strongly adaptive online learning over partial intervals

Elastic online deep learning for dynamic streaming data

Online Linear Regression in Dynamic Environments via Discounting

Non-stationary Projection-free Online Learning with Dynamic and Adaptive Regret Guarantees

Adaptive Online Learning in Dynamic Environments.

Projection-free Online Learning in Dynamic Environments

Distributionally Time-Varying Online Stochastic Optimization under Polyak-Łojasiewicz Condition with Application in Conditional Value-at-Risk Statistical Learning

An adaptive transfer learning perspective on classification in non-stationary environments

Non-stationary Online Learning with Memory and Non-stochastic Control

Online Boosting Adaptive Learning under Concept Drift for Multistream Classification

Efficient Constrained Regret Minimization

Dynamic Regret of Online Markov Decision Processes

Algorithm Design for Online Meta-Learning with Task Boundary Detection

Handling New Class in Online Label Shift

Constrained Online Two-stage Stochastic Optimization: Near Optimal Algorithms via Adversarial Learning

Adaptive Chunk-Based Dynamic Weighted Majority for Imbalanced Data Streams With Concept Drift