Abstract:Learning with streaming data has attracted extensive research interest in recent years. Existing online learning approaches have specific assumptions regarding data streams, such as requiring fixed or varying feature spaces with explicit patterns and balanced class distributions. While the data streams generated in many real scenarios commonly have arbitrarily incomplete feature spaces and dynamic imbalanced class distributions, making existing approaches be unsuitable for real applications. To address this issue, this paper proposes a novel Online Learning from Incomplete and Imbalanced Data Streams (OLI $^{2}$ DS) algorithm. OLI $^{2}$ DS has a two-fold main idea: 1) it follows the empirical risk minimization principle to identify the most informative features of incomplete feature spaces, and 2) it develops a dynamic cost strategy to handle imbalanced class distributions in real-time by transforming F-measure optimization into a weighted surrogate loss minimization. To evaluate OLI $^{2}$ DS, we compare it with state-of-the-art related algorithms in three kinds of experiments. First, we adopt 14 real datasets to simulate three scenarios of incomplete feature spaces, i.e., trapezoidal, feature evolvable, and capricious data streams. Second, based on a benchmark online analyzer, we generate 13 datasets to simulate incomplete data streams with different imbalance ratios. Third, we analyze concept drift in two simulated scenes, i.e., online learning and data stream mining, and verify the adaption of OLI $^{2}$ DS on repeated concept drifts and variable imbalance ratios. The results demonstrate that OLI $^{2}$ DS achieves a significantly better performance than its rivals. Besides, a real-world case study on movie review classification is conducted to elaborate on our OLI $^{2}$ DS algorithm's effectiveness. Code is released at https://github.com/youdianlong/OLI2DS.

Online Learning from Incomplete Data Streams for Multi-classification

Online Learning from Incomplete Data Streams with Partial Labels for Multi-Classification.

Online Learning for Data Streams with Incomplete Features and Labels

Online Learning From Incomplete and Imbalanced Data Streams

A comprehensive active learning method for multiclass imbalanced data streams with concept drift

Online Active Learning for Drifting Data Streams

Online Semi-Supervised Active Learning Ensemble Classification for Evolving Imbalanced Data Streams

Online Learning from Capricious Data Streams Via Shared and New Feature Spaces

Online Imbalance Learning with Unpredictable Feature Evolution and Label Scarcity

Active Broad Learning with Multi-Objective Evolution for Data Stream Classification

A Framework of Sparse Online Learning and Its Applications

Online Reliable Semi-supervised Learning on Evolving Data Streams

Online Boosting Adaptive Learning under Concept Drift for Multistream Classification

High-Dimensional Multi-Label Data Stream Classification with Concept Drifting Detection

A Novel SMOTE-Based Classification Approach to Online Data Imbalance Problem

Online Fairness-Aware Learning with Imbalanced Data Streams

Learning Evolving Prototypes for Imbalanced Data Stream Classification with Limited Labels

A Learning Framework for Online Class Imbalance Learning.

Learning from Data Streams and Class Imbalance

Intensive Class Imbalance Learning in Drifting Data Streams

Robust Online Active Learning with Cluster-Based Local Drift Detection for Unbalanced Imperfect Data