Abstract:Continual acquisition of novel experience without interfering with previously learned knowledge, i.e., continual learning, is critical for artificial neural networks, while limited by catastrophic forgetting. A neural network adjusts its parameters when learning a new task but then fails to conduct the old tasks well. By contrast, the biological brain can effectively address catastrophic forgetting through consolidating memories as more specific or more generalized forms to complement each other, which is achieved in the interplay of the hippocampus and neocortex, mediated by the prefrontal cortex. Inspired by such a brain strategy, we propose a novel approach named triple-memory networks (TMNs) for continual learning. TMNs model the interplay of the three brain regions as a triple-network architecture of generative adversarial networks (GANs). The input information is encoded as specific representations of data distributions in a generator, or generalized knowledge of solving tasks in a discriminator and a classifier, with implementing appropriate brain-inspired algorithms to alleviate catastrophic forgetting in each module. Particularly, the generator replays generated data of the learned tasks to the discriminator and the classifier, both of which are implemented with a weight consolidation regularizer to complement the lost information in the generation process. TMNs achieve the state-of-the-art performance of generative memory replay on a variety of class-incremental learning benchmarks on MNIST, SVHN, CIFAR-10, and ImageNet-50.

Continual Learning by Modeling Intra-Class Variation

Progressive Learning without Forgetting

Incorporating neuro-inspired adaptability for continual learning in artificial intelligence

Continual Recognition with Adaptive Memory Update.

Lifelong Learning Process: Self-Memory Supervising and Dynamically Growing Networks

Reinforced Continual Learning

Continual Learning of Multi-modal Dynamics with External Memory

Triple-Memory Networks: A Brain-Inspired Method for Continual Learning

Learning to Modulate Random Weights: Neuromodulation-inspired Neural Networks For Efficient Continual Learning

Learn to Grow: A Continual Structure Learning Framework for Overcoming Catastrophic Forgetting

Temporal-Difference Variational Continual Learning

Sparsity and Heterogeneous Dropout for Continual Learning in the Null Space of Neural Activations

Studying Generalization on Memory-Based Methods in Continual Learning

Overcoming Catastrophic Forgetting for Continual Learning Via Model Adaptation

Learning to Remember: A Synaptic Plasticity Driven Framework for Continual Learning

Mixture-of-Variational-Experts for Continual Learning

Learning to Continually Learn with the Bayesian Principle

Continual Learning with Pretrained Backbones by Tuning in the Input Space

Continual Learning via Manifold Expansion Replay

Recall-Oriented Continual Learning with Generative Adversarial Meta-Model

Continual Classification Learning Using Generative Models