Abstract:In streaming data classification, most of the existing methods assume that all arrived evolving data are completely labeled. One challenge is that some applications where only small amount of labeled examples are available for training. Incremental semi-supervised learning algorithms have been proposed for regularizing neural networks by incorporating various side information, such as pairwise constraints or user-provided labels. However, it is hard to put them into practice, especially for non-stationary environments due to the effectiveness and parameter sensitivity of such algorithms. In this paper, we propose a novel incremental semi-supervised learning framework on streaming data. Each layer of model is comprised of a generative network, a discriminant structure and the bridge. The generative network uses dynamic feature learning based on autoencoders to learn generative features from streaming data which has been demonstrated its potential in learning latent feature representations. In addition, the discriminant structure regularizes the network construction via building pairwise similarity and dissimilarity constraints. It is also used for facilitating the parameter learning of the generative network. The network and structure are integrated into a joint learning framework and bridged by enforcing the correlation of their parameters, which balances the flexible incorporation of supervision information and numerical tractability for non-stationary environments as well as explores the intrinsic data structure. Moreover, an efficient algorithm is designed to solve the proposed optimization problem and we also give an ensemble method. Particularly, when multiple layers of model are stacked, the performance is significantly boosted. Finally, to validate the effectiveness of the proposed method, extensive experiments are conducted on synthetic and real-life datasets. The experimental results demonstrate that the performance of the proposed algorithms is superior to some state-of-the-art approaches.

Streaming Continual Learning for Unified Adaptive Intelligence in Dynamic Environments

Adaptive Streaming Continuous Learning System for Video Analytics

Streaming LifeLong Learning With Any-Time Inference

Multitask Diffusion Adaptation over Networks with Common Latent Representations

Edge-Cloud Collaborative Streaming Video Analytics with Multi-agent Deep Reinforcement Learning

A Two-Stream Continual Learning System with Variational Domain-Agnostic Feature Replay

Interactive Continual Learning: Fast and Slow Thinking

Lifelong Machine Learning with Deep Streaming Linear Discriminant Analysis

Incremental semi-supervised learning on streaming data.

Dynamic Consolidation for Continual Learning

A Unified Replay-based Continuous Learning Framework for Spatio-Temporal Prediction on Streaming Data

Federated Continuous Learning With Broad Network Architecture

Concept Accumulation and Gradient-Guided Adaption for Continual Learning in Evolving Streaming

Continual Learning with Diffusion-based Generative Replay for Industrial Streaming Data

Federated Continual Learning Goes Online: Uncertainty-Aware Memory Management for Vision Tasks and Beyond

A Novel Continuous Learning and Collaborative Decision Making Mechanism for Real-Time Cooperation of Humanoid Service Robots

Adaptive Stream Processing on Edge Devices through Active Inference

VERSE: Virtual-Gradient Aware Streaming Lifelong Learning with Anytime Inference

Streaming Network for Continual Learning of Object Relocations under Household Context Drifts

Streaming Label Learning for Modeling Labels on the Fly.

Federated Continual Learning via Knowledge Fusion: A Survey