Abstract:In AI, generalization refers to a model's ability to perform well on out-of-distribution data related to the given task, beyond the data it was trained on. For an AI agent to excel, it must also possess the continual learning capability, whereby an agent incrementally learns to perform a sequence of tasks without forgetting the previously acquired knowledge to solve the old tasks. Intuitively, generalization within a task allows the model to learn underlying features that can readily be applied to novel tasks, facilitating quicker learning and enhanced performance in subsequent tasks within a continual learning framework. Conversely, continual learning methods often include mechanisms to mitigate catastrophic forgetting, ensuring that knowledge from earlier tasks is retained. This preservation of knowledge over tasks plays a role in enhancing generalization for the ongoing task at hand. Despite the intuitive appeal of the interplay of both abilities, existing literature on continual learning and generalization has proceeded separately. In the preliminary effort to promote studies that bridge both fields, we first present empirical evidence showing that each of these fields has a mutually positive effect on the other. Next, building upon this finding, we introduce a simple and effective technique known as Shape-Texture Consistency Regularization (STCR), which caters to continual learning. STCR learns both shape and texture representations for each task, consequently enhancing generalization and thereby mitigating forgetting. Remarkably, extensive experiments validate that our STCR, can be seamlessly integrated with existing continual learning methods, where its performance surpasses these continual learning methods in isolation or when combined with established generalization techniques by a large margin. Our data and source code will be made publicly available upon publication.

Studying Generalization on Memory-Based Methods in Continual Learning

Regularization Shortcomings for Continual Learning

Continual Learning by Modeling Intra-Class Variation

Distributionally Robust Memory Evolution With Generalized Divergence for Continual Learning

Unveiling the Tapestry: the Interplay of Generalization and Forgetting in Continual Learning

Continual Learning: Less Forgetting, More OOD Generalization via Adaptive Contrastive Replay

Memory Enhanced Replay for Continual Learning

Continual Learning in Human Activity Recognition: an Empirical Analysis of Regularization

Looking Through the Past: Better Knowledge Retention for Generative Replay in Continual Learning

Infinite dSprites for Disentangled Continual Learning: Separating Memory Edits from Generalization

Continual Learning via Manifold Expansion Replay

The Ideal Continual Learner: An Agent That Never Forgets

Optimization and Generalization of Regularization-Based Continual Learning: a Loss Approximation Viewpoint

Sparsity and Heterogeneous Dropout for Continual Learning in the Null Space of Neural Activations

Continual Recognition with Adaptive Memory Update.

Continual learning with invertible generative models

Memory-Free Generative Replay For Class-Incremental Learning

Memory Population in Continual Learning via Outlier Elimination

Adversarially Diversified Rehearsal Memory (ADRM): Mitigating Memory Overfitting Challenge in Continual Learning

Class-Incremental Learning Using Generative Experience Replay Based on Time-aware Regularization

A Continual Learning Method for Reducing Class Interference Based on Replay