Abstract:Deep neural networks (DNNs) have gained great success in information fusion. However, recent studies report that DNNs are suffering from catastrophic forgetting, i.e., DNNs would forget the knowledge learned from previous tasks when training on the current task. To address this issue, continual learning is proposed to enhance long-term memories for DNNs. Since continual learning is very challenging, existing work simplifies the setting to simulate the sequentially online multi-task learning paradigm. Specifically, existing works commonly split one dataset into multiple disjoint categories to get multiple tasks that follow the same marginal distribution. We argue that this setting is too simple to approximate the real-world applications. In real-world scenarios, the data distributions of sequentially arrived tasks would change significantly from time to time, e.g., the lighting from day to night, and the background from spring to winter. Thus, the real-world applications are in a multi-view manner, yet existing methods ignore this challenge. To tame this, we propose Adaptive Online Continual Multi-view Learning (AOCML) to align distributions and reduce catastrophic forgetting as new tasks arrive. AOCML integrates experience replay and adversarial learning in an end-to-end framework, which stores samples in a memory buffer to replay previous tasks, while leveraging a discriminator to adaptively align distributions across views on-the-fly. In addition to common replay buffer, we also incorporate a soft label-based replay and an entropy-based reweighting to further prevent forgetting. Extensive experiments on four datasets verify that our method is able to significantly outperform previous CL methods and our method pushes CL one step forward towards practical multi-view orientation.

Class-Incremental Lifelong Learning in Multi-Label Classification

AGCN: Augmented Graph Convolutional Network for Lifelong Multi-label Image Recognition

Dual Enhancement for Multi-Label Learning with Missing Labels

Multi-Label Continual Learning Using Augmented Graph Convolutional Network

Overcoming Catastrophic Forgetting for Multi-Label Class-Incremental Learning

Knowledge Restore and Transfer for Multi-label Class-Incremental Learning

Rebalancing Multi-Label Class-Incremental Learning

Confidence Self-Calibration for Multi-Label Class-Incremental Learning

Few-Shot Incremental Learning for Label-to-Image Translation

Optimizing Class Distribution in Memory for Multi-Label Online Continual Learning

More Classifiers, Less Forgetting: A Generic Multi-classifier Paradigm for Incremental Learning

Efficient Class Incremental Learning for Multi-Label Classification of Evolving Data Streams

Class-Incremental Learning based on Label Generation

Scalable Label Distribution Learning for Multi-Label Classification

Enhancing Multi-Label Classification Via Dynamic Label-Order Learning

Discovering Latent Class Labels for Multi-Label Learning

A Novel Progressive Multi-label Classifier for Classincremental Data.

Label Mapping Neural Networks with Response Consolidation for Class Incremental Learning.

Large Scale Incremental Learning

Adaptive online continual multi-view learning

Memory Efficient Class-Incremental Learning for Image Classification