Abstract:Continual learning enables learning systems to adapt to evolving data distributions by sequentially acquiring knowledge from a series of tasks. Unsupervised lifelong learning refers to the ability to learn over time while memorizing previous patterns without supervision. However, the prior methods in this field heavily rely on supervised or reinforcement learning, which necessitates annotated data, thereby limiting their scalability in real-world applications where data is often biased and lacks annotations. To overcome these challenges, this work introduces a novel approach called L ifelong L earning gets better with MixUp and U nsupervised C ontinual R epresentation (LL-UCR). LL-UCR aims to learn feature representations from unlabeled tasks, eliminating the need for annotated data. Within the LL-UCR framework, two innovative techniques are introduced: LL-MixUp, which mitigates catastrophic forgetting by interpolating samples between current and previous tasks, and Dark Experience Replay (DER) Buzzega et al. ( Adv Neural Inf Process Syst , 33 , 15920–15930 2020) adapted for UCR, aligning network logits across tasks. To overcome buffer size limitations in replay-based methods, the Retrospective Adversarial Replay (RAR) framework is incorporated, facilitating diverse replay sample generation. Through systematic analysis, we demonstrate that unsupervised visual representations exhibit remarkable resilience to catastrophic forgetting, consistently outperforming supervised methods in terms of performance and generalization on out-of-distribution tasks. Furthermore, our qualitative analysis reveals that LL-UCR fosters a smoother loss landscape and acquires meaningful feature representations. Extensive experimental evaluations conducted on diverse datasets validate the superior performance of LL-UCR compared to state-of-the-art supervised continual learning methods and the unsupervised LUMP Madaan et al. ( International conference on learning representations , 2020) method, effectively mitigating catastrophic forgetting.

InfoUCL: Learning Informative Representations for Unsupervised Continual Learning

UniGrad-FS: Unified Gradient Projection with Flatter Sharpness for Continual Learning

R epresentational c ontinuity for u nsupervised c ontinual l earning

Representational Continuity for Unsupervised Continual Learning

Rethinking the Representational Continuity: Towards Unsupervised Continual Learning

CUCL: Codebook for Unsupervised Continual Learning.

Must Unsupervised Continual Learning Relies on Previous Information?

Mejigclu: more effective jigsaw clustering for unsupervised visual representation learning

Effective Data Selection and Replay for Unsupervised Continual Learning

Continual Contrastive Learning for Cross-Dataset Scene Classification

Integrating Present and Past in Unsupervised Continual Learning

Unsupervised Feature Learning by Cross-Level Instance-Group Discrimination

Patch-Based Contrastive Learning and Memory Consolidation for Online Unsupervised Continual Learning

Unified Contrastive Learning in Image-Text-Label Space

Continual Vision-Language Representation Learning with Off-Diagonal Information

ULD-Net: 3D unsupervised learning by dense similarity learning with equivariant-crop

Don't Stop Learning: Towards Continual Learning for the CLIP Model

Learning the Unlearned: Mitigating Feature Suppression in Contrastive Learning

Continuous Contrastive Learning for Long-Tailed Semi-Supervised Recognition

Lifelong learning gets better with MixUp and unsupervised continual representation

Enhancing Visual Continual Learning with Language-Guided Supervision