Abstract:Online continual learning requires the models to learn from constant, endless streams of data. While significant efforts have been made in this field, most were focused on mitigating the catastrophic forgetting issue to achieve better classification ability, at the cost of a much heavier training workload. They overlooked that in real-world scenarios, e.g., in high-speed data stream environments, data do not pause to accommodate slow models. In this paper, we emphasize that model throughput -- defined as the maximum number of training samples that a model can process within a unit of time -- is equally important. It directly limits how much data a model can utilize and presents a challenging dilemma for current methods. With this understanding, we revisit key challenges in OCL from both empirical and theoretical perspectives, highlighting two critical issues beyond the well-documented catastrophic forgetting: Model's ignorance: the single-pass nature of OCL challenges models to learn effective features within constrained training time and storage capacity, leading to a trade-off between effective learning and model throughput; Model's myopia: the local learning nature of OCL on the current task leads the model to adopt overly simplified, task-specific features and excessively sparse classifier, resulting in the gap between the optimal solution for the current task and the global objective. To tackle these issues, we propose the Non-sparse Classifier Evolution framework (NsCE) to facilitate effective global discriminative feature learning with minimal time cost. NsCE integrates non-sparse maximum separation regularization and targeted experience replay techniques with the help of pre-trained models, enabling rapid acquisition of new globally discriminative features.

Continual Learning in Linear Classification on Separable Data

Regularization Shortcomings for Continual Learning

Continual Learning in Human Activity Recognition: an Empirical Analysis of Regularization

Fixed Design Analysis of Regularization-Based Continual Learning

Learning Continually by Spectral Regularization

Continual Classification Learning Using Generative Models

Can Continual Learning Improve Long-Tailed Recognition? Toward a Unified Framework

A Statistical Theory of Regularization-Based Continual Learning

Continual Learning: Applications and the Road Forward

Understanding Forgetting in Continual Learning with Linear Regression

Dissecting Continual Learning a Structural and Data Analysis

Hypernetworks for Continual Semi-Supervised Learning

On the Effectiveness of Equivariant Regularization for Robust Online Continual Learning

Latent Spectral Regularization for Continual Learning

Continual Learning with Guarantees via Weight Interval Constraints

Optimization and Generalization of Regularization-Based Continual Learning: a Loss Approximation Viewpoint

Regularizing Second-Order Influences for Continual Learning

SLCA: Slow Learner with Classifier Alignment for Continual Learning on a Pre-trained Model

Forgetting, Ignorance or Myopia: Revisiting Key Challenges in Online Continual Learning

Continual Learning on a Diet: Learning from Sparsely Labeled Streams Under Constrained Computation