Abstract:Online continual learning for image classification studies the problem of learning to classify images from an online stream of data and tasks, where tasks may include new classes (class incremental) or data nonstationarity (domain incremental). One of the key challenges of continual learning is to avoid catastrophic forgetting (CF), i.e., forgetting old tasks in the presence of more recent tasks. Over the past few years, a large range of methods and tricks have been introduced to address the continual learning problem, but many have not been fairly and systematically compared under a variety of realistic and practical settings. To better understand the relative advantages of various approaches and the settings where they work best, this survey aims to (1) compare state-of-the-art methods such as Maximally Interfered Retrieval (MIR), iCARL, and GDumb (a very strong baseline) and determine which works best at different memory and data settings as well as better understand the key source of CF; (2) determine if the best online class incremental methods are also competitive in the domain incremental setting; and (3) evaluate the performance of 7 simple but effective tricks such as the "review" trick and the nearest class mean (NCM) classifier to assess their relative impact. Regarding (1), we observe that iCaRL remains competitive when the memory buffer is small; GDumb outperforms many recently proposed methods in medium-size datasets and MIR performs the best in larger-scale datasets. For (2), we note that GDumb performs quite poorly while MIR — already competitive for (1) — is also strongly competitive in this very different (but important) continual learning setting. Overall, this allows us to conclude that MIR is overall a strong and versatile online continual learning method across a wide variety of settings. Finally for (3), we find that all tricks are beneficial, and when augmented with the "review" trick and NCM classifier, MIR produces performance levels that bring online continual learning much closer to its ultimate goal of matching offline training. Our codes are available at https://github.com/RaptorMai/online-continual-learning.

Online-LoRA: Task-free Online Continual Learning via Low Rank Adaptation

Dual Low-Rank Adaptation for Continual Learning with Pre-Trained Models

Adaptive Rank, Reduced Forgetting: Knowledge Retention in Continual Learning Vision-Language Models with Dynamic Rank-Selective LoRA

Continual Forgetting for Pre-trained Vision Models

Task Arithmetic with LoRA for Continual Learning

Online Active Continual Learning for Robotic Lifelong Object Recognition

A Comprehensive Empirical Evaluation on Online Continual Learning

An Online Continual Object Detector on VHR Remote Sensing Images with Class Imbalance.

Expressive and Generalizable Low-rank Adaptation for Large Models via Slow Cascaded Learning

Overcoming Domain Drift in Online Continual Learning

Contrastive Correlation Preserving Replay for Online Continual Learning

Controlled Low-Rank Adaptation with Subspace Regularization for Continued Training on Large Language Models

Orthogonal Subspace Learning for Language Model Continual Learning

Online Continual Learning with Contrastive Vision Transformer

LoRA-IR: Taming Low-Rank Experts for Efficient All-in-One Image Restoration

CURLoRA: Stable LLM Continual Fine-Tuning and Catastrophic Forgetting Mitigation

An Empirical Analysis of Forgetting in Pre-trained Models with Incremental Low-Rank Updates

Forgetting, Ignorance or Myopia: Revisiting Key Challenges in Online Continual Learning

Adaptive online continual multi-view learning

Online continual learning in image classification: An empirical survey

LoRA Done RITE: Robust Invariant Transformation Equilibration for LoRA Optimization