Abstract:Learning from a sequence of tasks for a lifetime is essential for an agent toward artificial general intelligence. Despite the explosion of this research field in recent years, most work focuses on the well-known catastrophic forgetting issue. In contrast, this work aims to explore knowledge-transferable lifelong learning without storing historical data and significant additional computational overhead. We demonstrate that existing data-free frameworks, including regularization-based single-network and structure-based multinetwork frameworks, face a fundamental issue of lifelong learning, named anterograde forgetting, i.e., preserving and transferring memory may inhibit the learning of new knowledge. We attribute it to the fact that the learning network capacity decreases while memorizing historical knowledge and conceptual confusion between the irrelevant old knowledge and the current task. Inspired by the complementary learning theory in neuroscience, we endow artificial neural networks with the ability to continuously learn without forgetting while recalling historical knowledge to facilitate learning new knowledge. Specifically, this work proposes a general framework named cycle memory networks (CMNs). The CMN consists of two individual memory networks to store short-and long-term memories separately to avoid capacity shrinkage and a transfer cell between them. It enables knowledge transfer from the long-term to the short-term memory network to mitigate conceptual confusion. In addition, the memory consolidation mechanism integrates short-term knowledge into the long-term memory network for knowledge accumulation. We demonstrate that the CMN can effectively address the anterograde forgetting on several task-related, task-conflict, class-incremental, and cross-domain benchmarks. Furthermore, we provide extensive ablation studies to verify each framework component. The source codes are available at: https://github.com/GeoX-Lab/CMN.

BNS: Building Network Structures Dynamically for Continual Learning

Progressive Learning without Forgetting

Achieving Forgetting Prevention and Knowledge Transfer in Continual Learning

Sub-network Discovery and Soft-masking for Continual Learning of Mixed Tasks

Lifelong Learning With Cycle Memory Networks

Beyond Not-Forgetting: Continual Learning with Backward Knowledge Transfer

Learning After Learning: Positive Backward Transfer in Continual Learning

Continual Learning in the Teacher-Student Setup: Impact of Task Similarity

Continual Learning by Using Information of Each Class Holistically.

Learn to Grow: A Continual Structure Learning Framework for Overcoming Catastrophic Forgetting

Enhancing Knowledge Transfer for Task Incremental Learning with Data-free Subnetwork.

Achieving a Better Stability-Plasticity Trade-off via Auxiliary Networks in Continual Learning

Online Continual Learning with Declarative Memory

Bio-inspired, task-free continual learning through activity regularization

PNSP: Overcoming Catastrophic Forgetting Using Primary Null Space Projection in Continual Learning

A Broad Neural Network Structure for Class Incremental Learning.

Enhancing Efficient Continual Learning with Dynamic Structure Development of Spiking Neural Networks

Revisiting Neural Networks for Continual Learning: An Architectural Perspective

NPCL: Neural Processes for Uncertainty-Aware Continual Learning

Dual-CBA: Improving Online Continual Learning via Dual Continual Bias Adaptors from a Bi-level Optimization Perspective

Continual Learning with Dependency Preserving Hypernetworks