Abstract:Deep neural networks (DNNs) have gained great success in information fusion. However, recent studies report that DNNs are suffering from catastrophic forgetting, i.e., DNNs would forget the knowledge learned from previous tasks when training on the current task. To address this issue, continual learning is proposed to enhance long-term memories for DNNs. Since continual learning is very challenging, existing work simplifies the setting to simulate the sequentially online multi-task learning paradigm. Specifically, existing works commonly split one dataset into multiple disjoint categories to get multiple tasks that follow the same marginal distribution. We argue that this setting is too simple to approximate the real-world applications. In real-world scenarios, the data distributions of sequentially arrived tasks would change significantly from time to time, e.g., the lighting from day to night, and the background from spring to winter. Thus, the real-world applications are in a multi-view manner, yet existing methods ignore this challenge. To tame this, we propose Adaptive Online Continual Multi-view Learning (AOCML) to align distributions and reduce catastrophic forgetting as new tasks arrive. AOCML integrates experience replay and adversarial learning in an end-to-end framework, which stores samples in a memory buffer to replay previous tasks, while leveraging a discriminator to adaptively align distributions across views on-the-fly. In addition to common replay buffer, we also incorporate a soft label-based replay and an entropy-based reweighting to further prevent forgetting. Extensive experiments on four datasets verify that our method is able to significantly outperform previous CL methods and our method pushes CL one step forward towards practical multi-view orientation.

Wandering Within a World: Online Contextualized Few-Shot Learning

Revisiting the Spatial and Temporal Modeling for Few-shot Action Recognition

Towards Few-Shot Learning in the Open World: A Review and Beyond

LDCA: Local Descriptors with Contextual Augmentation for Few-Shot Learning

Context-Transformer: Tackling Object Confusion for Few-Shot Detection

Gestalt-Guided Image Understanding for Few-Shot Learning

Information Extraction Enhancement for Few-Shot Object Detection in Remote Sensing Images

BiLSTM-TANet: an adaptive diverse scenes model with context embeddings for few-shot learning

Less is More: A Closer Look at Semantic-based Few-Shot Learning

Unsupervised Few-Shot Feature Learning Via Self-Supervised Training

Few-shot Learning for Domain-specific Fine-grained Image Classification

Incorporating simulated spatial context information improves the effectiveness of contrastive learning models

Expanding continual few-shot learning benchmarks to include recognition of specific instances

Exemplar-free Online Continual Learning

The broader spectrum of in-context learning

Cross Modal Few-Shot Contextual Transfer for Heterogenous Image Classification

TDNet: A Novel Transductive Learning Framework with Conditional Metric Embedding for Few-shot Remote Sensing Image Scene Classification

Instance-Level Embedding Adaptation for Few-Shot Learning

Only Image Cosine Embedding for Few-Shot Learning

Adaptive online continual multi-view learning