Abstract:Deep neural networks (DNNs) have gained great success in information fusion. However, recent studies report that DNNs are suffering from catastrophic forgetting, i.e., DNNs would forget the knowledge learned from previous tasks when training on the current task. To address this issue, continual learning is proposed to enhance long-term memories for DNNs. Since continual learning is very challenging, existing work simplifies the setting to simulate the sequentially online multi-task learning paradigm. Specifically, existing works commonly split one dataset into multiple disjoint categories to get multiple tasks that follow the same marginal distribution. We argue that this setting is too simple to approximate the real-world applications. In real-world scenarios, the data distributions of sequentially arrived tasks would change significantly from time to time, e.g., the lighting from day to night, and the background from spring to winter. Thus, the real-world applications are in a multi-view manner, yet existing methods ignore this challenge. To tame this, we propose Adaptive Online Continual Multi-view Learning (AOCML) to align distributions and reduce catastrophic forgetting as new tasks arrive. AOCML integrates experience replay and adversarial learning in an end-to-end framework, which stores samples in a memory buffer to replay previous tasks, while leveraging a discriminator to adaptively align distributions across views on-the-fly. In addition to common replay buffer, we also incorporate a soft label-based replay and an entropy-based reweighting to further prevent forgetting. Extensive experiments on four datasets verify that our method is able to significantly outperform previous CL methods and our method pushes CL one step forward towards practical multi-view orientation.

Adaptive Feature Generation for Online Continual Learning from Imbalanced Data

Adaptive online continual multi-view learning

TARGET: Federated Class-Continual Learning Via Exemplar-Free Distillation

A Masking, Linkage and Guidance Framework for Online Class Incremental Learning

Online Analytic Exemplar-Free Continual Learning with Large Models for Imbalanced Autonomous Driving Task

Generative Feature Replay For Class-Incremental Learning

Online Imbalance Learning with Unpredictable Feature Evolution and Label Scarcity

Generative Feature Replay with Orthogonal Weight Modification for Continual Learning

Non-Exemplar Online Class-incremental Continual Learning via Dual-prototype Self-augment and Refinement

New Insights on Relieving Task-Recency Bias for Online Class Incremental Learning

A Novel SMOTE-Based Classification Approach to Online Data Imbalance Problem

Autonomous Generative Feature Replay for Non-Exemplar Class-Incremental Learning

Progressive Prototype Evolving for Dual-Forgetting Mitigation in Non-Exemplar Online Continual Learning

Adaptive Online Incremental Learning for Evolving Data Streams

Bypassing Logits Bias in Online Class-Incremental Learning with a Generative Framework

Forgetting, Ignorance or Myopia: Revisiting Key Challenges in Online Continual Learning

Overcoming Domain Drift in Online Continual Learning

Rethinking Class-Incremental Learning from a Dynamic Imbalanced Learning Perspective

Squeezing More Past Knowledge for Online Class-Incremental Continual Learning

Online Prototype Learning for Online Continual Learning

Learning Invariant Features for Online Continual Learning