Abstract:Deep neural networks (DNNs) have gained great success in information fusion. However, recent studies report that DNNs are suffering from catastrophic forgetting, i.e., DNNs would forget the knowledge learned from previous tasks when training on the current task. To address this issue, continual learning is proposed to enhance long-term memories for DNNs. Since continual learning is very challenging, existing work simplifies the setting to simulate the sequentially online multi-task learning paradigm. Specifically, existing works commonly split one dataset into multiple disjoint categories to get multiple tasks that follow the same marginal distribution. We argue that this setting is too simple to approximate the real-world applications. In real-world scenarios, the data distributions of sequentially arrived tasks would change significantly from time to time, e.g., the lighting from day to night, and the background from spring to winter. Thus, the real-world applications are in a multi-view manner, yet existing methods ignore this challenge. To tame this, we propose Adaptive Online Continual Multi-view Learning (AOCML) to align distributions and reduce catastrophic forgetting as new tasks arrive. AOCML integrates experience replay and adversarial learning in an end-to-end framework, which stores samples in a memory buffer to replay previous tasks, while leveraging a discriminator to adaptively align distributions across views on-the-fly. In addition to common replay buffer, we also incorporate a soft label-based replay and an entropy-based reweighting to further prevent forgetting. Extensive experiments on four datasets verify that our method is able to significantly outperform previous CL methods and our method pushes CL one step forward towards practical multi-view orientation.

Multi-Label Continual Learning Using Augmented Graph Convolutional Network

AGCN: Augmented Graph Convolutional Network for Lifelong Multi-label Image Recognition

Dual Enhancement for Multi-Label Learning with Missing Labels

Class-Incremental Lifelong Learning in Multi-Label Classification

Multi-Label Classification with Label Graph Superimposing

Multi-Label Image Recognition With Graph Convolutional Networks

Learning Graph Convolutional Networks for Multi-Label Recognition and Applications

Overcoming Catastrophic Forgetting for Multi-Label Class-Incremental Learning

Adaptive online continual multi-view learning

Attention-Augmented Memory Network for Image Multi-Label Classification

Instance-Aware Deep Graph Learning for Multi-Label Classification

Label-aware Graph Representation Learning for Multi-Label Image Classification

Instance-Aware Graph Convolutional Network for Multi-Label Classification

Knowledge Restore and Transfer for Multi-label Class-Incremental Learning

Attention-Driven Dynamic Graph Convolutional Network for Multi-Label Image Recognition

Research of multi-label text classification based on label attention and correlation networks

An Attention-based Representation Distillation Baseline for Multi-Label Continual Learning

GKGNet: Group K-Nearest Neighbor based Graph Convolutional Network for Multi-Label Image Recognition

Multi-Modal Multi-Instance Multi-Label Learning with Graph Convolutional Network

Multilabel Recognition Algorithm With Multigraph Structure