Abstract:Deep neural networks (DNNs) have gained great success in information fusion. However, recent studies report that DNNs are suffering from catastrophic forgetting, i.e., DNNs would forget the knowledge learned from previous tasks when training on the current task. To address this issue, continual learning is proposed to enhance long-term memories for DNNs. Since continual learning is very challenging, existing work simplifies the setting to simulate the sequentially online multi-task learning paradigm. Specifically, existing works commonly split one dataset into multiple disjoint categories to get multiple tasks that follow the same marginal distribution. We argue that this setting is too simple to approximate the real-world applications. In real-world scenarios, the data distributions of sequentially arrived tasks would change significantly from time to time, e.g., the lighting from day to night, and the background from spring to winter. Thus, the real-world applications are in a multi-view manner, yet existing methods ignore this challenge. To tame this, we propose Adaptive Online Continual Multi-view Learning (AOCML) to align distributions and reduce catastrophic forgetting as new tasks arrive. AOCML integrates experience replay and adversarial learning in an end-to-end framework, which stores samples in a memory buffer to replay previous tasks, while leveraging a discriminator to adaptively align distributions across views on-the-fly. In addition to common replay buffer, we also incorporate a soft label-based replay and an entropy-based reweighting to further prevent forgetting. Extensive experiments on four datasets verify that our method is able to significantly outperform previous CL methods and our method pushes CL one step forward towards practical multi-view orientation.

Diffusion-Driven Data Replay: A Novel Approach to Combat Forgetting in Federated Class Continual Learning

Using Diffusion Models as Generative Replay in Continual Federated Learning -- What will Happen?

TARGET: Federated Class-Continual Learning Via Exemplar-Free Distillation

DDGR: Continual Learning with Deep Diffusion-based Generative Replay.

Addressing Catastrophic Forgetting in Federated Learning on Resource-Constrained Devices: A Feature Replay Approach

Accurate Forgetting for Heterogeneous Federated Continual Learning

Data-Free Federated Class Incremental Learning with Diffusion-Based Generative Memory

Continual Offline Reinforcement Learning via Diffusion-based Dual Generative Replay

Towards Efficient Replay in Federated Incremental Learning

Continual Learning with Diffusion-based Generative Replay for Industrial Streaming Data

Class-Incremental Learning using Diffusion Model for Distillation and Replay

Rehearsal-Free Domain Continual Face Anti-Spoofing: Generalize More and Forget Less

Adaptive online continual multi-view learning

Diffusion Model Meets Non-Exemplar Class-Incremental Learning and Beyond

Adaptive Memory Replay for Continual Learning

Don't Memorize; Mimic The Past: Federated Class Incremental Learning Without Episodic Memory

Overcoming Spatial-Temporal Catastrophic Forgetting for Federated Class-Incremental Learning

Dmaf: Data-Model Anti-Forgetting for Federated Incremental Learning

CORE: Mitigating Catastrophic Forgetting in Continual Learning through Cognitive Replay

Squeezing More Past Knowledge for Online Class-Incremental Continual Learning

SR-FDIL: Synergistic Replay for Federated Domain-Incremental Learning