Abstract:In streaming data classification, most of the existing methods assume that all arrived evolving data are completely labeled. One challenge is that some applications where only small amount of labeled examples are available for training. Incremental semi-supervised learning algorithms have been proposed for regularizing neural networks by incorporating various side information, such as pairwise constraints or user-provided labels. However, it is hard to put them into practice, especially for non-stationary environments due to the effectiveness and parameter sensitivity of such algorithms. In this paper, we propose a novel incremental semi-supervised learning framework on streaming data. Each layer of model is comprised of a generative network, a discriminant structure and the bridge. The generative network uses dynamic feature learning based on autoencoders to learn generative features from streaming data which has been demonstrated its potential in learning latent feature representations. In addition, the discriminant structure regularizes the network construction via building pairwise similarity and dissimilarity constraints. It is also used for facilitating the parameter learning of the generative network. The network and structure are integrated into a joint learning framework and bridged by enforcing the correlation of their parameters, which balances the flexible incorporation of supervision information and numerical tractability for non-stationary environments as well as explores the intrinsic data structure. Moreover, an efficient algorithm is designed to solve the proposed optimization problem and we also give an ensemble method. Particularly, when multiple layers of model are stacked, the performance is significantly boosted. Finally, to validate the effectiveness of the proposed method, extensive experiments are conducted on synthetic and real-life datasets. The experimental results demonstrate that the performance of the proposed algorithms is superior to some state-of-the-art approaches.

Incremental Feature Spaces Learning with Label Scarcity

Online Learning with Incremental Feature Space and Bandit Feedback

Online Imbalance Learning with Unpredictable Feature Evolution and Label Scarcity

Feature space learning model

Incremental Shared Subspace Learning for Multi-label Classification.

Streaming Label Learning for Modeling Labels on the Fly.

FLea: Addressing Data Scarcity and Label Skew in Federated Learning via Privacy-preserving Feature Augmentation

Incremental Learning for Simultaneous Augmentation of Feature and Class.

Online Learning from Capricious Data Streams Via Shared and New Feature Spaces

A Feature Space Learning Model Based on Semi-Supervised Clustering

Learning with Incremental Instances and Features.

Incremental semi-supervised learning on streaming data.

Fast Online Incremental Learning On Mixture Streaming Data

Class Incremental Learning Based on Local Structure Constraints in Feature Space

Feature Space Augmentation for Long-Tailed Data

Multi-feature Space Similarity Supplement for Few-Shot Class Incremental Learning

ALRS: an Attention Loss Function Based on Row-Sparsity for Incremental Learning.

Synthesized Feature based Few-Shot Class-Incremental Learning on a Mixture of Subspaces

Stochastic Feature Averaging for Learning with Long-Tailed Noisy Labels

Online Learning in Variable Feature Spaces under Incomplete Supervision.

Online Learning for Data Streams with Incomplete Features and Labels