Abstract:Deep neural networks (DNNs) have gained great success in information fusion. However, recent studies report that DNNs are suffering from catastrophic forgetting, i.e., DNNs would forget the knowledge learned from previous tasks when training on the current task. To address this issue, continual learning is proposed to enhance long-term memories for DNNs. Since continual learning is very challenging, existing work simplifies the setting to simulate the sequentially online multi-task learning paradigm. Specifically, existing works commonly split one dataset into multiple disjoint categories to get multiple tasks that follow the same marginal distribution. We argue that this setting is too simple to approximate the real-world applications. In real-world scenarios, the data distributions of sequentially arrived tasks would change significantly from time to time, e.g., the lighting from day to night, and the background from spring to winter. Thus, the real-world applications are in a multi-view manner, yet existing methods ignore this challenge. To tame this, we propose Adaptive Online Continual Multi-view Learning (AOCML) to align distributions and reduce catastrophic forgetting as new tasks arrive. AOCML integrates experience replay and adversarial learning in an end-to-end framework, which stores samples in a memory buffer to replay previous tasks, while leveraging a discriminator to adaptively align distributions across views on-the-fly. In addition to common replay buffer, we also incorporate a soft label-based replay and an entropy-based reweighting to further prevent forgetting. Extensive experiments on four datasets verify that our method is able to significantly outperform previous CL methods and our method pushes CL one step forward towards practical multi-view orientation.

Progressive Prototype Evolving for Dual-Forgetting Mitigation in Non-Exemplar Online Continual Learning

Progressive Learning without Forgetting

Online Prototype Learning for Online Continual Learning

Non-Exemplar Online Class-incremental Continual Learning via Dual-prototype Self-augment and Refinement

TARGET: Federated Class-Continual Learning Via Exemplar-Free Distillation

Forgetting, Ignorance or Myopia: Revisiting Key Challenges in Online Continual Learning

Improving Plasticity in Online Continual Learning via Collaborative Learning

HPCR: Holistic Proxy-based Contrastive Replay for Online Continual Learning

FPPL: An Efficient and Non-IID Robust Federated Continual Learning Framework

Squeezing More Past Knowledge for Online Class-Incremental Continual Learning

Contrastive Correlation Preserving Replay for Online Continual Learning

Adaptive online continual multi-view learning

Dual Memory Model for Experience-Once Task-Incremental Lifelong Learning.

AOCIL: Exemplar-free Analytic Online Class Incremental Learning with Low Time and Resource Consumption

Prototype-Sample Relation Distillation: Towards Replay-Free Continual Learning

Adaptive Feature Generation for Online Continual Learning from Imbalanced Data

PCR: Proxy-based Contrastive Replay for Online Class-Incremental Continual Learning

Orchestrate Latent Expertise: Advancing Online Continual Learning with Multi-Level Supervision and Reverse Self-Distillation

Exemplar-free Online Continual Learning

Contrastive Continual Learning with Importance Sampling and Prototype-Instance Relation Distillation

Online Continual Learning through Mutual Information Maximization.